[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:52:07 dist-test-slave-m9hg krb5kdc[11468](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:52:07 dist-test-slave-m9hg krb5kdc[11468](info): set up 2 sockets
Sep 24 12:52:07 dist-test-slave-m9hg krb5kdc[11468](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260924 12:52:08.193030 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:52:08 dist-test-slave-m9hg krb5kdc[11468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:52:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:52:08.403198 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:37579
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:37579
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:08.738855 11481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:08.739244 11481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:08.739419 11481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:08.747591 11481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:08.747773 11481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:08.747879 11481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:08.747980 11481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:08.748073 11481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:52:08.758520 11481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:37579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:37579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:08.759979 11481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:08.761376 11481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:08.775420 11489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:08.775641 11486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:08.775646 11487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:08.777174 11481 server_base.cc:1034] running on GCE node
I20260924 12:52:08.778286 11481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:08.780407 11481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:08.781703 11481 hybrid_clock.cc:648] HybridClock initialized: now 1790254328781615 us; error 78 us; skew 500 ppm
I20260924 12:52:08.782270 11481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:08 dist-test-slave-m9hg krb5kdc[11468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254328, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:08.786993 11481 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:52:08.789618 11481 webserver.cc:460] Webserver started at http://127.11.49.126:38853/ using document root <none> and password file <none>
I20260924 12:52:08.790912 11481 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:08.791074 11481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:08.791399 11481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:08.795552 11481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "933372650ff942e4bea8ba059eb09f13"
format_stamp: "Formatted at 2026-09-24 12:52:08 on dist-test-slave-m9hg"
server_key: "a0ab2d861ffe49e4111be540dd07359e"
server_key_iv: "572a6d5ca341b4656fc775c506600b9d"
server_key_version: "encryptionkey@0"
I20260924 12:52:08.796705 11481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "933372650ff942e4bea8ba059eb09f13"
format_stamp: "Formatted at 2026-09-24 12:52:08 on dist-test-slave-m9hg"
server_key: "a0ab2d861ffe49e4111be540dd07359e"
server_key_iv: "572a6d5ca341b4656fc775c506600b9d"
server_key_version: "encryptionkey@0"
I20260924 12:52:08.804062 11481 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260924 12:52:08.809496 11496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:08.811890 11481 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260924 12:52:08.812207 11481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "933372650ff942e4bea8ba059eb09f13"
format_stamp: "Formatted at 2026-09-24 12:52:08 on dist-test-slave-m9hg"
server_key: "a0ab2d861ffe49e4111be540dd07359e"
server_key_iv: "572a6d5ca341b4656fc775c506600b9d"
server_key_version: "encryptionkey@0"
I20260924 12:52:08.812567 11481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:08.840047 11481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:08.846772 11481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:08.847208 11481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:08.874738 11481 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:37579
I20260924 12:52:08.874815 11547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:37579 every 8 connection(s)
I20260924 12:52:08.876880 11481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:08.881367 11548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:08.887706 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 11481
I20260924 12:52:08.888257 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:08.890717 11461 external_mini_cluster.cc:1428] Setting key 8a8107ac35d463ce3b31cf6af72d1fb4
I20260924 12:52:08.892688 11548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13: Bootstrap starting.
I20260924 12:52:08.896772 11548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:08.898401 11548 log.cc:824] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:08.901568 11548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13: No bootstrap required, opened a new log
I20260924 12:52:08.910591 11548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933372650ff942e4bea8ba059eb09f13" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37579 } }
I20260924 12:52:08.911149 11548 raft_consensus.cc:374] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:08.911291 11548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 933372650ff942e4bea8ba059eb09f13, State: Initialized, Role: FOLLOWER
I20260924 12:52:08.911969 11548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933372650ff942e4bea8ba059eb09f13" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37579 } }
I20260924 12:52:08.912200 11548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:08.912464 11548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:08.912621 11548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:08.914821 11548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933372650ff942e4bea8ba059eb09f13" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37579 } }
I20260924 12:52:08.915372 11548 leader_election.cc:302] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 933372650ff942e4bea8ba059eb09f13; no voters:
I20260924 12:52:08.916157 11548 leader_election.cc:288] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:08.916298 11553 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:08.917451 11553 raft_consensus.cc:686] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [term 1 LEADER]: Becoming Leader. State: Replica: 933372650ff942e4bea8ba059eb09f13, State: Running, Role: LEADER
I20260924 12:52:08.918859 11553 consensus_queue.cc:237] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933372650ff942e4bea8ba059eb09f13" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37579 } }
I20260924 12:52:08.919924 11548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:08.922147 11555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "933372650ff942e4bea8ba059eb09f13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933372650ff942e4bea8ba059eb09f13" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37579 } } }
I20260924 12:52:08.922678 11555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:08.923409 11554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 933372650ff942e4bea8ba059eb09f13. Latest consensus state: current_term: 1 leader_uuid: "933372650ff942e4bea8ba059eb09f13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "933372650ff942e4bea8ba059eb09f13" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37579 } } }
I20260924 12:52:08.923936 11554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:08.926146 11558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Sep 24 12:52:08 dist-test-slave-m9hg krb5kdc[11468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:08.945809 11558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:08.969547 11550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:08.895969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60114 (local address 127.11.49.126:37579)
0924 12:52:08.898125 (+ 2156us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:08.898145 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:08.900011 (+ 1866us) server_negotiation.cc:407] Connection header received
0924 12:52:08.909870 (+ 9859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:08.909904 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:08.910467 (+ 563us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:08.911029 (+ 562us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:08.916533 (+ 5504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:08.919694 (+ 3161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:08.923165 (+ 3471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:08.924536 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:08.924860 (+ 324us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:08.938076 (+ 13216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:08.938100 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:08.938138 (+ 38us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:08.938252 (+ 114us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:08.954804 (+ 16552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:08.958224 (+ 3420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:08.958236 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:08.958267 (+ 31us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:08.958888 (+ 621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:08.960092 (+ 1204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:08.960101 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:08.960106 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:08.961310 (+ 1204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:08.961749 (+ 439us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:08.965773 (+ 4024us) server_negotiation.cc:299] Negotiation successful
0924 12:52:08.967018 (+ 1245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1807,"thread_start_us":1457,"threads_started":1}
I20260924 12:52:08.973080 11558 catalog_manager.cc:1347] Generated new cluster ID: 5f1bca76e18d4c3b8b9ce575ed3bda63
I20260924 12:52:08.973495 11558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:08.986765 11558 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:08.988459 11558 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:09.000214 11558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 933372650ff942e4bea8ba059eb09f13: Generated new TSK 0
I20260924 12:52:09.001237 11558 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:52:09.067965 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37579
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:09.405727 11574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:09.406033 11574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:09.406174 11574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:09.413784 11574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:09.413913 11574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:09.414077 11574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:52:09.424880 11574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37579
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:09.426123 11574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:09.427421 11574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:09.442545 11582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:09.442652 11579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:09.442613 11580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:09.446228 11574 server_base.cc:1034] running on GCE node
I20260924 12:52:09.446918 11574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:09.447948 11574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:09.449201 11574 hybrid_clock.cc:648] HybridClock initialized: now 1790254329449115 us; error 82 us; skew 500 ppm
I20260924 12:52:09.449553 11574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:09 dist-test-slave-m9hg krb5kdc[11468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254329, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:09.453424 11574 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:52:09.455384 11574 webserver.cc:460] Webserver started at http://127.11.49.65:37973/ using document root <none> and password file <none>
I20260924 12:52:09.456298 11574 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:09.456455 11574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:09.456779 11574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:09.459744 11574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "7af90b1c140c4fe88063092b5462df71"
format_stamp: "Formatted at 2026-09-24 12:52:09 on dist-test-slave-m9hg"
server_key: "894d9431368f23f56e0292e1deef4ff4"
server_key_iv: "36035a88ee48b55feb97d3bedbbe6311"
server_key_version: "encryptionkey@0"
I20260924 12:52:09.460590 11574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "7af90b1c140c4fe88063092b5462df71"
format_stamp: "Formatted at 2026-09-24 12:52:09 on dist-test-slave-m9hg"
server_key: "894d9431368f23f56e0292e1deef4ff4"
server_key_iv: "36035a88ee48b55feb97d3bedbbe6311"
server_key_version: "encryptionkey@0"
I20260924 12:52:09.466361 11574 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260924 12:52:09.470389 11589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:09.472013 11574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260924 12:52:09.472229 11574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "7af90b1c140c4fe88063092b5462df71"
format_stamp: "Formatted at 2026-09-24 12:52:09 on dist-test-slave-m9hg"
server_key: "894d9431368f23f56e0292e1deef4ff4"
server_key_iv: "36035a88ee48b55feb97d3bedbbe6311"
server_key_version: "encryptionkey@0"
I20260924 12:52:09.472517 11574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:09.487907 11574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:09.492729 11574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:09.493040 11574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:09.494125 11574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:09.495556 11574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:09.495678 11574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:09.495843 11574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:09.495925 11574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:09.537283 11574 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:37895
I20260924 12:52:09.537328 11701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:37895 every 8 connection(s)
I20260924 12:52:09.538549 11574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:52:09.547523 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 11574
I20260924 12:52:09.547763 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:52:09.548472 11461 external_mini_cluster.cc:1428] Setting key a367be1b1ca509df4428b8cbf4c565de
Sep 24 12:52:09 dist-test-slave-m9hg krb5kdc[11468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254329, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:52:09.564805 11704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:09.541893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:60207 (local address 127.11.49.126:37579)
0924 12:52:09.542526 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:09.542532 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:09.543646 (+ 1114us) server_negotiation.cc:407] Connection header received
0924 12:52:09.545953 (+ 2307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:09.545960 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:09.546079 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:09.546227 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:09.548533 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:09.549611 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:09.551591 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:09.552041 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:09.552198 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:09.557549 (+ 5351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:09.557556 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:09.557560 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:09.557608 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:09.560820 (+ 3212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:09.561931 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:09.561935 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:09.561938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:09.562081 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:09.562606 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:09.562616 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:09.562618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:09.562954 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:09.563124 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:09.564033 (+ 909us) server_negotiation.cc:299] Negotiation successful
0924 12:52:09.564377 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":322,"threads_started":1}
I20260924 12:52:09.566218 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:09.542435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:37579 (local address 127.11.49.65:60207)
0924 12:52:09.543392 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:09.543458 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:09.545543 (+ 2085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:09.546557 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:09.546568 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:09.547312 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:09.548221 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:09.548245 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:09.549835 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:09.549840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:09.551393 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:09.551412 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:09.552380 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:09.552388 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:09.552689 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:09.553595 (+ 906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:09.553622 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:09.557122 (+ 3500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:09.561107 (+ 3985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:09.561119 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:09.561142 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:09.561752 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:09.562207 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:09.562212 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:09.562216 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:09.562470 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:09.563094 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:09.563105 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:09.563600 (+ 495us) client_negotiation.cc:769] Sending connection context
0924 12:52:09.563924 (+ 324us) client_negotiation.cc:240] Negotiation successful
0924 12:52:09.564663 (+ 739us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":359,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
I20260924 12:52:09.568738 11702 heartbeater.cc:347] Connected to a master server at 127.11.49.126:37579
I20260924 12:52:09.569136 11702 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:09.569969 11702 heartbeater.cc:511] Master 127.11.49.126:37579 requested a full tablet report, sending...
I20260924 12:52:09.572244 11513 ts_manager.cc:194] Registered new tserver with Master: 7af90b1c140c4fe88063092b5462df71 (127.11.49.65:37895)
I20260924 12:52:09.574596 11513 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:60207
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:52:09.592139 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37579
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:09.935837 11708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:09.936152 11708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:09.936259 11708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:09.943683 11708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:09.943889 11708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:09.944012 11708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:52:09.953913 11708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37579
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:09.955193 11708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:09.956699 11708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:09.970780 11716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:09.970804 11713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:09.970894 11714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:09.972712 11708 server_base.cc:1034] running on GCE node
I20260924 12:52:09.973464 11708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:09.974802 11708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:09.976141 11708 hybrid_clock.cc:648] HybridClock initialized: now 1790254329976070 us; error 81 us; skew 500 ppm
I20260924 12:52:09.976770 11708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:09 dist-test-slave-m9hg krb5kdc[11468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254329, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:09.981107 11708 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:52:09.982864 11708 webserver.cc:460] Webserver started at http://127.11.49.66:38369/ using document root <none> and password file <none>
I20260924 12:52:09.983554 11708 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:09.983661 11708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:09.983928 11708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:09.986990 11708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "bd13ae103c99492080ca61f85d6d4f11"
format_stamp: "Formatted at 2026-09-24 12:52:09 on dist-test-slave-m9hg"
server_key: "4f2652d5f68a785494726f28006458a6"
server_key_iv: "667ee35b1021663a76d0aedbc78b9410"
server_key_version: "encryptionkey@0"
I20260924 12:52:09.987742 11708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "bd13ae103c99492080ca61f85d6d4f11"
format_stamp: "Formatted at 2026-09-24 12:52:09 on dist-test-slave-m9hg"
server_key: "4f2652d5f68a785494726f28006458a6"
server_key_iv: "667ee35b1021663a76d0aedbc78b9410"
server_key_version: "encryptionkey@0"
I20260924 12:52:09.993842 11708 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260924 12:52:09.998328 11723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:10.000686 11708 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:52:10.001001 11708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "bd13ae103c99492080ca61f85d6d4f11"
format_stamp: "Formatted at 2026-09-24 12:52:09 on dist-test-slave-m9hg"
server_key: "4f2652d5f68a785494726f28006458a6"
server_key_iv: "667ee35b1021663a76d0aedbc78b9410"
server_key_version: "encryptionkey@0"
I20260924 12:52:10.001309 11708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:10.020961 11708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:10.027232 11708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:10.027735 11708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:10.029361 11708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:10.031395 11708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:10.031505 11708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:10.031726 11708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:10.031810 11708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:10.077816 11708 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:41851
I20260924 12:52:10.077837 11835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:41851 every 8 connection(s)
I20260924 12:52:10.079807 11708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:52:10.084108 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 11708
I20260924 12:52:10.084436 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:52:10.085044 11461 external_mini_cluster.cc:1428] Setting key 650c78ffdca0527ebe5845022a4e728c
Sep 24 12:52:10 dist-test-slave-m9hg krb5kdc[11468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254329, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
I20260924 12:52:10.108572 11838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:10.083363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:32791 (local address 127.11.49.126:37579)
0924 12:52:10.085026 (+ 1663us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:10.085036 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:10.086147 (+ 1111us) server_negotiation.cc:407] Connection header received
0924 12:52:10.088232 (+ 2085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:10.088236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:10.088421 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:10.088558 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:10.091105 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.091964 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.094932 (+ 2968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.095467 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.095699 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:10.100686 (+ 4987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:10.100693 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:10.100697 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:10.100746 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:10.104220 (+ 3474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.105424 (+ 1204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.105433 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.105439 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.105614 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.106226 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.106230 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.106233 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.106535 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:10.106707 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:10.107557 (+ 850us) server_negotiation.cc:299] Negotiation successful
0924 12:52:10.108041 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1454,"thread_start_us":1261,"threads_started":1}
I20260924 12:52:10.109977 11839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:10.084023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:37579 (local address 127.11.49.66:32791)
0924 12:52:10.085508 (+ 1485us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:10.085586 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:10.087768 (+ 2182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:10.088905 (+ 1137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:10.088920 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:10.089830 (+ 910us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:10.090793 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:10.090826 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.092331 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.092341 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:10.094680 (+ 2339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:10.094708 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.095853 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.095861 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:10.096187 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:10.097255 (+ 1068us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:10.097286 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:10.100206 (+ 2920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:10.104500 (+ 4294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:10.104510 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:10.104527 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:10.105247 (+ 720us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:10.105742 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:10.105748 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:10.105752 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:10.106046 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:10.106669 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:10.106686 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:10.107186 (+ 500us) client_negotiation.cc:769] Sending connection context
0924 12:52:10.107464 (+ 278us) client_negotiation.cc:240] Negotiation successful
0924 12:52:10.108403 (+ 939us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1052,"thread_start_us":779,"threads_started":1}
I20260924 12:52:10.112174 11836 heartbeater.cc:347] Connected to a master server at 127.11.49.126:37579
I20260924 12:52:10.112643 11836 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:10.113646 11836 heartbeater.cc:511] Master 127.11.49.126:37579 requested a full tablet report, sending...
I20260924 12:52:10.115895 11513 ts_manager.cc:194] Registered new tserver with Master: bd13ae103c99492080ca61f85d6d4f11 (127.11.49.66:41851)
I20260924 12:52:10.117455 11513 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:32791
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:52:10.132156 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37579
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:10.467375 11842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:10.467710 11842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:10.467818 11842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:10.476228 11842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:10.476382 11842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:10.476511 11842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:52:10.488046 11842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37579
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:10.489429 11842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:10.490779 11842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:10.506645 11848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:10.507088 11850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:10.506645 11847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:10.508435 11842 server_base.cc:1034] running on GCE node
I20260924 12:52:10.509155 11842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:10.510293 11842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:10.511580 11842 hybrid_clock.cc:648] HybridClock initialized: now 1790254330511528 us; error 53 us; skew 500 ppm
I20260924 12:52:10.511977 11842 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:10 dist-test-slave-m9hg krb5kdc[11468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254330, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:10.522146 11842 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:52:10.524151 11842 webserver.cc:460] Webserver started at http://127.11.49.67:33845/ using document root <none> and password file <none>
I20260924 12:52:10.525005 11842 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:10.525127 11842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:10.525494 11842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:10.528749 11842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "42d4fd65177b4d80a6bb0d991a3bc240"
format_stamp: "Formatted at 2026-09-24 12:52:10 on dist-test-slave-m9hg"
server_key: "a8940bdfec27aa98340114c5b66ffbfa"
server_key_iv: "1429184c6d0997535c123e80bd2e659b"
server_key_version: "encryptionkey@0"
I20260924 12:52:10.529584 11842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "42d4fd65177b4d80a6bb0d991a3bc240"
format_stamp: "Formatted at 2026-09-24 12:52:10 on dist-test-slave-m9hg"
server_key: "a8940bdfec27aa98340114c5b66ffbfa"
server_key_iv: "1429184c6d0997535c123e80bd2e659b"
server_key_version: "encryptionkey@0"
I20260924 12:52:10.535660 11842 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260924 12:52:10.541338 11857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:10.543422 11842 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260924 12:52:10.543603 11842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "42d4fd65177b4d80a6bb0d991a3bc240"
format_stamp: "Formatted at 2026-09-24 12:52:10 on dist-test-slave-m9hg"
server_key: "a8940bdfec27aa98340114c5b66ffbfa"
server_key_iv: "1429184c6d0997535c123e80bd2e659b"
server_key_version: "encryptionkey@0"
I20260924 12:52:10.543834 11842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:10.566583 11842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:10.571703 11842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:10.571970 11842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:10.573172 11842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:10.574725 11842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:10.574811 11842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:10.574899 11842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:10.574949 11842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:10.578974 11702 heartbeater.cc:503] Master 127.11.49.126:37579 was elected leader, sending a full tablet report...
I20260924 12:52:10.615797 11842 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:40089
I20260924 12:52:10.615859 11969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:40089 every 8 connection(s)
I20260924 12:52:10.617228 11842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:52:10.624212 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 11842
I20260924 12:52:10.624509 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:52:10.624970 11461 external_mini_cluster.cc:1428] Setting key 82be21f5c60d80b21e2b3eef9c45d1d0
Sep 24 12:52:10 dist-test-slave-m9hg krb5kdc[11468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254330, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:10.643989 11972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:10.620893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:37953 (local address 127.11.49.126:37579)
0924 12:52:10.621641 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:10.621647 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:10.622602 (+ 955us) server_negotiation.cc:407] Connection header received
0924 12:52:10.626206 (+ 3604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:10.626213 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:10.626339 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:10.626496 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:10.628741 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.629815 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.631491 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.631996 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.632114 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:10.636014 (+ 3900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:10.636021 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:10.636025 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:10.636077 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:10.639576 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.640898 (+ 1322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.640904 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.640907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.641086 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.641645 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.641649 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.641652 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.642138 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:10.642292 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:10.643357 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0924 12:52:10.643623 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":292,"threads_started":1}
I20260924 12:52:10.644887 11973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:10.621435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:37579 (local address 127.11.49.67:37953)
0924 12:52:10.622364 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:10.622420 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:10.625380 (+ 2960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:10.626889 (+ 1509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:10.626899 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:10.627706 (+ 807us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:10.628502 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:10.628529 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.629971 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.629975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:10.631294 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:10.631307 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.632237 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.632242 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:10.632562 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:10.633385 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:10.633409 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:10.635690 (+ 2281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:10.639829 (+ 4139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:10.639844 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:10.639860 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:10.640687 (+ 827us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:10.641246 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:10.641258 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:10.641262 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:10.641492 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:10.642304 (+ 812us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:10.642322 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:10.642812 (+ 490us) client_negotiation.cc:769] Sending connection context
0924 12:52:10.643198 (+ 386us) client_negotiation.cc:240] Negotiation successful
0924 12:52:10.643648 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":330,"threads_started":1}
I20260924 12:52:10.646843 11970 heartbeater.cc:347] Connected to a master server at 127.11.49.126:37579
I20260924 12:52:10.647245 11970 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:10.648159 11970 heartbeater.cc:511] Master 127.11.49.126:37579 requested a full tablet report, sending...
I20260924 12:52:10.650230 11513 ts_manager.cc:194] Registered new tserver with Master: 42d4fd65177b4d80a6bb0d991a3bc240 (127.11.49.67:40089)
I20260924 12:52:10.651249 11513 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:37953
I20260924 12:52:10.656806 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 24 12:52:10 dist-test-slave-m9hg krb5kdc[11468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254330, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 24 12:52:10 dist-test-slave-m9hg krb5kdc[11468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254330, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:52:10.716584 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:10.694444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43026 (local address 127.11.49.65:37895)
0924 12:52:10.695508 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:10.695516 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:10.695559 (+ 43us) server_negotiation.cc:407] Connection header received
0924 12:52:10.695927 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:10.695935 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:10.696172 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:10.696456 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:10.698364 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.699590 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.701410 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.702054 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.702190 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:10.707917 (+ 5727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:10.707935 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:10.707952 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:10.708002 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:10.711737 (+ 3735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.713320 (+ 1583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.713329 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.713332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.713536 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.714256 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.714261 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.714263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.714730 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:10.715011 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:10.715650 (+ 639us) server_negotiation.cc:299] Negotiation successful
0924 12:52:10.715957 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":882,"thread_start_us":721,"threads_started":1}
W20260924 12:52:10.718628 11617 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43026
Sep 24 12:52:10 dist-test-slave-m9hg krb5kdc[11468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 24 12:52:10 dist-test-slave-m9hg krb5kdc[11468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:52:10.773646 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:10.757810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43034 (local address 127.11.49.65:37895)
0924 12:52:10.758051 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:10.758058 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:10.758344 (+ 286us) server_negotiation.cc:407] Connection header received
0924 12:52:10.758606 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:10.758611 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:10.758694 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:10.758810 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:10.760367 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.761159 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.762555 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.763018 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.763171 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:10.767873 (+ 4702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:10.767878 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:10.767882 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:10.767923 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:10.770904 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.771636 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.771648 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.771652 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.771776 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.772146 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.772154 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.772158 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.772497 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:10.772757 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:10.773057 (+ 300us) server_negotiation.cc:299] Negotiation successful
0924 12:52:10.773296 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260924 12:52:10.775921 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 11574
I20260924 12:52:10.793047 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:10.777435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43050 (local address 127.11.49.65:37895)
0924 12:52:10.777719 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:10.777726 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:10.777922 (+ 196us) server_negotiation.cc:407] Connection header received
0924 12:52:10.778116 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:10.778121 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:10.778205 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:10.778312 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:10.780087 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.780945 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.782608 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.783059 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.783190 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:10.786176 (+ 2986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:10.786181 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:10.786185 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:10.786224 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:10.789340 (+ 3116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.790416 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.790421 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.790423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.790578 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.791358 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.791362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.791364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.791706 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:10.791900 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:10.792474 (+ 574us) server_negotiation.cc:299] Negotiation successful
0924 12:52:10.792706 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260924 12:52:10.794076 11697 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:10.891532 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 11574
I20260924 12:52:10.909134 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 11708
Sep 24 12:52:10 dist-test-slave-m9hg krb5kdc[11468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:52:10.928928 11985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:10.910281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39804 (local address 127.11.49.66:41851)
0924 12:52:10.910949 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:10.910957 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:10.910992 (+ 35us) server_negotiation.cc:407] Connection header received
0924 12:52:10.911064 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:10.911071 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:10.911303 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:10.911476 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:10.913007 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.914174 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.915710 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:10.916397 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:10.916545 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:10.921989 (+ 5444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:10.922003 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:10.922019 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:10.922060 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:10.925224 (+ 3164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.926399 (+ 1175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.926406 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.926409 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.926546 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:10.927056 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:10.927059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:10.927061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:10.927448 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:10.927686 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:10.928159 (+ 473us) server_negotiation.cc:299] Negotiation successful
0924 12:52:10.928606 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":362,"threads_started":1}
I20260924 12:52:10.930449 11831 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:11.029539 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 11708
I20260924 12:52:11.047799 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 11842
Sep 24 12:52:11 dist-test-slave-m9hg krb5kdc[11468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:52:11.066150 11987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:11.049211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46284 (local address 127.11.49.67:40089)
0924 12:52:11.049805 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:11.049813 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:11.049843 (+ 30us) server_negotiation.cc:407] Connection header received
0924 12:52:11.049901 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:11.049907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:11.050166 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:11.050342 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:11.051672 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:11.052732 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:11.054040 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:11.054577 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:11.054789 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:11.059640 (+ 4851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:11.059651 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:11.059664 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:11.059702 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:11.063116 (+ 3414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:11.063876 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:11.063884 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:11.063887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:11.064014 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:11.064440 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:11.064446 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:11.064450 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:11.064859 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:11.065159 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:11.065494 (+ 335us) server_negotiation.cc:299] Negotiation successful
0924 12:52:11.065779 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":258,"threads_started":1}
I20260924 12:52:11.067648 11965 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:11.164045 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 11842
I20260924 12:52:11.180430 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 11481
I20260924 12:52:11.181808 11543 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:11.300057 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 11481
2026-09-24T12:52:11Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4280 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:52:11 dist-test-slave-m9hg krb5kdc[11992](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:52:11 dist-test-slave-m9hg krb5kdc[11992](info): set up 2 sockets
Sep 24 12:52:11 dist-test-slave-m9hg krb5kdc[11992](info): commencing operation
krb5kdc: starting...
W20260924 12:52:12.440606 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.006s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:52:12 dist-test-slave-m9hg krb5kdc[11992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:52:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:52:12.661024 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38561
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:38561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:13.077126 12005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:13.077558 12005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:13.077675 12005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:13.086753 12005 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:13.086949 12005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:13.087003 12005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:13.087064 12005 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:13.087116 12005 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:52:13.098948 12005 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:38561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:13.100812 12005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:13.102489 12005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:13.117627 12010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:13.118069 12011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:13.118211 12013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:13.119542 12005 server_base.cc:1034] running on GCE node
I20260924 12:52:13.120641 12005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:13.122354 12005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:13.123672 12005 hybrid_clock.cc:648] HybridClock initialized: now 1790254333123544 us; error 85 us; skew 500 ppm
I20260924 12:52:13.124089 12005 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:13 dist-test-slave-m9hg krb5kdc[11992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254333, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:13.128149 12005 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:52:13.130061 12005 webserver.cc:460] Webserver started at http://127.11.49.126:33557/ using document root <none> and password file <none>
I20260924 12:52:13.130898 12005 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:13.131058 12005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:13.131420 12005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:13.134888 12005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "433649a4957a43dda81ecba53605252c"
format_stamp: "Formatted at 2026-09-24 12:52:13 on dist-test-slave-m9hg"
server_key: "d755a92bc2eb56da627dd710f9c64d6e"
server_key_iv: "d070f80504dba6c5421adf20f4b76adb"
server_key_version: "encryptionkey@0"
I20260924 12:52:13.135756 12005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "433649a4957a43dda81ecba53605252c"
format_stamp: "Formatted at 2026-09-24 12:52:13 on dist-test-slave-m9hg"
server_key: "d755a92bc2eb56da627dd710f9c64d6e"
server_key_iv: "d070f80504dba6c5421adf20f4b76adb"
server_key_version: "encryptionkey@0"
I20260924 12:52:13.142160 12005 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260924 12:52:13.146330 12020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:13.147984 12005 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260924 12:52:13.148200 12005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "433649a4957a43dda81ecba53605252c"
format_stamp: "Formatted at 2026-09-24 12:52:13 on dist-test-slave-m9hg"
server_key: "d755a92bc2eb56da627dd710f9c64d6e"
server_key_iv: "d070f80504dba6c5421adf20f4b76adb"
server_key_version: "encryptionkey@0"
I20260924 12:52:13.148494 12005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:13.170379 12005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:13.174790 12005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:13.175127 12005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:13.196965 12005 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:38561
I20260924 12:52:13.197016 12071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:38561 every 8 connection(s)
I20260924 12:52:13.198534 12005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:13.203773 12072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:13.206015 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 12005
I20260924 12:52:13.206326 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:13.207324 11461 external_mini_cluster.cc:1428] Setting key fd7f8301e8c17cf04857fd3ad3ec6744
I20260924 12:52:13.224692 12072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c: Bootstrap starting.
Sep 24 12:52:13 dist-test-slave-m9hg krb5kdc[11992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:13.230655 12072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:13.232661 12072 log.cc:824] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:13.237784 12072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c: No bootstrap required, opened a new log
I20260924 12:52:13.239835 12075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:13.210266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54292 (local address 127.11.49.126:38561)
0924 12:52:13.211291 (+ 1025us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:13.211309 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:13.211361 (+ 52us) server_negotiation.cc:407] Connection header received
0924 12:52:13.213447 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:13.213475 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:13.213973 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:13.214367 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:13.216907 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:13.218486 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:13.220733 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:13.221580 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:13.221760 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:13.228319 (+ 6559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:13.228336 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:13.228365 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:13.228452 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:13.233456 (+ 5004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:13.234720 (+ 1264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:13.234732 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:13.234745 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:13.235072 (+ 327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:13.235521 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:13.235527 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:13.235530 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:13.236515 (+ 985us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:13.236902 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:13.237393 (+ 491us) server_negotiation.cc:299] Negotiation successful
0924 12:52:13.238038 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":772,"thread_start_us":495,"threads_started":1}
I20260924 12:52:13.248736 12072 raft_consensus.cc:348] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433649a4957a43dda81ecba53605252c" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38561 } }
I20260924 12:52:13.249275 12072 raft_consensus.cc:374] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:13.249370 12072 raft_consensus.cc:729] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 433649a4957a43dda81ecba53605252c, State: Initialized, Role: FOLLOWER
I20260924 12:52:13.250238 12072 consensus_queue.cc:260] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433649a4957a43dda81ecba53605252c" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38561 } }
I20260924 12:52:13.250605 12072 raft_consensus.cc:388] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:13.250790 12072 raft_consensus.cc:482] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:13.250957 12072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:13.253988 12072 raft_consensus.cc:504] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433649a4957a43dda81ecba53605252c" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38561 } }
I20260924 12:52:13.254671 12072 leader_election.cc:302] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 433649a4957a43dda81ecba53605252c; no voters:
I20260924 12:52:13.255443 12072 leader_election.cc:288] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:13.255718 12077 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:13.258198 12077 raft_consensus.cc:686] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [term 1 LEADER]: Becoming Leader. State: Replica: 433649a4957a43dda81ecba53605252c, State: Running, Role: LEADER
I20260924 12:52:13.258862 12077 consensus_queue.cc:237] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433649a4957a43dda81ecba53605252c" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38561 } }
I20260924 12:52:13.259521 12072 sys_catalog.cc:564] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:13.262032 12079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 433649a4957a43dda81ecba53605252c. Latest consensus state: current_term: 1 leader_uuid: "433649a4957a43dda81ecba53605252c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433649a4957a43dda81ecba53605252c" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38561 } } }
I20260924 12:52:13.262040 12078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "433649a4957a43dda81ecba53605252c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "433649a4957a43dda81ecba53605252c" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38561 } } }
I20260924 12:52:13.262617 12079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:13.262682 12078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:13.263590 12082 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:13.269804 12082 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:13.281924 12082 catalog_manager.cc:1347] Generated new cluster ID: deaf163a522e4645a7185b38d3031493
I20260924 12:52:13.282073 12082 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:13.304365 12082 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:13.306285 12082 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:13.328043 12082 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 433649a4957a43dda81ecba53605252c: Generated new TSK 0
I20260924 12:52:13.329322 12082 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:52:13.389256 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38561
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:13.810319 12098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:13.810775 12098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:13.810964 12098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:13.819391 12098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:13.819617 12098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:13.819837 12098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:52:13.832363 12098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38561
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:13.834141 12098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:13.835912 12098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:13.852965 12104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:13.853058 12103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:13.852969 12106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:13.854619 12098 server_base.cc:1034] running on GCE node
I20260924 12:52:13.855464 12098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:13.856858 12098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:13.858137 12098 hybrid_clock.cc:648] HybridClock initialized: now 1790254333858028 us; error 89 us; skew 500 ppm
I20260924 12:52:13.858654 12098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:13 dist-test-slave-m9hg krb5kdc[11992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254333, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:13.863116 12098 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:52:13.865063 12098 webserver.cc:460] Webserver started at http://127.11.49.65:37263/ using document root <none> and password file <none>
I20260924 12:52:13.865851 12098 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:13.865969 12098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:13.866236 12098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:13.869418 12098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "67134c32c5c041a2a03be2cdeeb40bff"
format_stamp: "Formatted at 2026-09-24 12:52:13 on dist-test-slave-m9hg"
server_key: "c2d00579a095f0c632d7c785e5066b72"
server_key_iv: "faa0be39f772eecffea85291c0ebe371"
server_key_version: "encryptionkey@0"
I20260924 12:52:13.870283 12098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "67134c32c5c041a2a03be2cdeeb40bff"
format_stamp: "Formatted at 2026-09-24 12:52:13 on dist-test-slave-m9hg"
server_key: "c2d00579a095f0c632d7c785e5066b72"
server_key_iv: "faa0be39f772eecffea85291c0ebe371"
server_key_version: "encryptionkey@0"
I20260924 12:52:13.876821 12098 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260924 12:52:13.881516 12113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:13.883505 12098 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260924 12:52:13.883708 12098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "67134c32c5c041a2a03be2cdeeb40bff"
format_stamp: "Formatted at 2026-09-24 12:52:13 on dist-test-slave-m9hg"
server_key: "c2d00579a095f0c632d7c785e5066b72"
server_key_iv: "faa0be39f772eecffea85291c0ebe371"
server_key_version: "encryptionkey@0"
I20260924 12:52:13.883919 12098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:13.905084 12098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:13.909622 12098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:13.909893 12098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:13.910928 12098 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:13.912631 12098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:13.912712 12098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:13.912844 12098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:13.912914 12098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:13.953560 12098 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:43113
I20260924 12:52:13.953683 12225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:43113 every 8 connection(s)
I20260924 12:52:13.955101 12098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:52:13.955744 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 12098
I20260924 12:52:13.956071 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:52:13.957019 11461 external_mini_cluster.cc:1428] Setting key e8fa2f538abfdaec18fdedafcf2c4158
Sep 24 12:52:13 dist-test-slave-m9hg krb5kdc[11992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254333, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
I20260924 12:52:13.984576 12228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:13.958494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:43327 (local address 127.11.49.126:38561)
0924 12:52:13.959090 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:13.959100 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:13.960163 (+ 1063us) server_negotiation.cc:407] Connection header received
0924 12:52:13.962662 (+ 2499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:13.962669 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:13.962799 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:13.962941 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:13.965661 (+ 2720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:13.966436 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:13.970036 (+ 3600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:13.970501 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:13.970625 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:13.976212 (+ 5587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:13.976222 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:13.976229 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:13.976333 (+ 104us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:13.980057 (+ 3724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:13.981206 (+ 1149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:13.981212 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:13.981215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:13.981402 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:13.982000 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:13.982009 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:13.982014 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:13.982475 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:13.982634 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:13.983915 (+ 1281us) server_negotiation.cc:299] Negotiation successful
0924 12:52:13.984176 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":292,"threads_started":1}
I20260924 12:52:13.986251 12229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:13.958763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38561 (local address 127.11.49.65:43327)
0924 12:52:13.959944 (+ 1181us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:13.960008 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:13.962244 (+ 2236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:13.963290 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:13.963301 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:13.964089 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:13.965251 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:13.965293 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:13.966646 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:13.966656 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:13.969745 (+ 3089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:13.969795 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:13.970822 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:13.970832 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:13.971302 (+ 470us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:13.972322 (+ 1020us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:13.972381 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:13.975736 (+ 3355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:13.980412 (+ 4676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:13.980422 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:13.980439 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:13.981014 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:13.981527 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:13.981531 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:13.981533 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:13.981809 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:13.982740 (+ 931us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:13.982750 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:13.983348 (+ 598us) client_negotiation.cc:769] Sending connection context
0924 12:52:13.983749 (+ 401us) client_negotiation.cc:240] Negotiation successful
0924 12:52:13.984516 (+ 767us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"thread_start_us":420,"threads_started":1}
I20260924 12:52:13.988399 12226 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38561
I20260924 12:52:13.988831 12226 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:13.989802 12226 heartbeater.cc:511] Master 127.11.49.126:38561 requested a full tablet report, sending...
I20260924 12:52:13.992353 12037 ts_manager.cc:194] Registered new tserver with Master: 67134c32c5c041a2a03be2cdeeb40bff (127.11.49.65:43113)
I20260924 12:52:13.993968 12037 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:43327
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:52:14.011579 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38561
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:14.430868 12232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:14.431420 12232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:14.431629 12232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:14.440124 12232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:14.440402 12232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:14.440646 12232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:52:14.452785 12232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38561
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:14.454679 12232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:14.456599 12232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:14.475492 12240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:14.475536 12238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:14.475956 12237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:14.476716 12232 server_base.cc:1034] running on GCE node
I20260924 12:52:14.477557 12232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:14.479061 12232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:14.480440 12232 hybrid_clock.cc:648] HybridClock initialized: now 1790254334480374 us; error 48 us; skew 500 ppm
I20260924 12:52:14.480949 12232 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:14 dist-test-slave-m9hg krb5kdc[11992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254334, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:14.485697 12232 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:52:14.487829 12232 webserver.cc:460] Webserver started at http://127.11.49.66:46583/ using document root <none> and password file <none>
I20260924 12:52:14.488858 12232 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:14.489015 12232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:14.489359 12232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:14.492761 12232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "3daab7362912461fbd283832dc5ec6e0"
format_stamp: "Formatted at 2026-09-24 12:52:14 on dist-test-slave-m9hg"
server_key: "f237a84ffbd7ca842073789a3f3a4a51"
server_key_iv: "5479040744a30501c1074c1cce31ba7d"
server_key_version: "encryptionkey@0"
I20260924 12:52:14.493623 12232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "3daab7362912461fbd283832dc5ec6e0"
format_stamp: "Formatted at 2026-09-24 12:52:14 on dist-test-slave-m9hg"
server_key: "f237a84ffbd7ca842073789a3f3a4a51"
server_key_iv: "5479040744a30501c1074c1cce31ba7d"
server_key_version: "encryptionkey@0"
I20260924 12:52:14.499855 12232 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260924 12:52:14.504503 12247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:14.506407 12232 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:52:14.506666 12232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "3daab7362912461fbd283832dc5ec6e0"
format_stamp: "Formatted at 2026-09-24 12:52:14 on dist-test-slave-m9hg"
server_key: "f237a84ffbd7ca842073789a3f3a4a51"
server_key_iv: "5479040744a30501c1074c1cce31ba7d"
server_key_version: "encryptionkey@0"
I20260924 12:52:14.506897 12232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:14.536671 12232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:14.541360 12232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:14.541706 12232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:14.542881 12232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:14.544498 12232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:14.544615 12232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:14.544785 12232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:14.544862 12232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:14.585867 12232 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:38063
I20260924 12:52:14.585978 12359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:38063 every 8 connection(s)
I20260924 12:52:14.587373 12232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:52:14.596005 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 12232
I20260924 12:52:14.596282 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:52:14.596879 11461 external_mini_cluster.cc:1428] Setting key d81d8265d1fde0ae0a5952b01510607b
Sep 24 12:52:14 dist-test-slave-m9hg krb5kdc[11992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254334, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:14.610216 12362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:14.591117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:36145 (local address 127.11.49.126:38561)
0924 12:52:14.591651 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:14.591657 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:14.593060 (+ 1403us) server_negotiation.cc:407] Connection header received
0924 12:52:14.595107 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:14.595112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:14.595217 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:14.595349 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:14.597354 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:14.598071 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:14.599724 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:14.600170 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:14.600344 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:14.603981 (+ 3637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:14.603993 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:14.603997 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:14.604057 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:14.606886 (+ 2829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:14.607702 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:14.607712 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:14.607715 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:14.607837 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:14.608327 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:14.608336 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:14.608338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:14.608659 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:14.608823 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:14.609561 (+ 738us) server_negotiation.cc:299] Negotiation successful
0924 12:52:14.609809 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":278,"threads_started":1}
I20260924 12:52:14.611527 12363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:14.591887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38561 (local address 127.11.49.66:36145)
0924 12:52:14.592855 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:14.592915 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:14.594743 (+ 1828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:14.595651 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:14.595660 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:14.596436 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:14.597140 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:14.597162 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:14.598252 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:14.598257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:14.599542 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:14.599561 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:14.600445 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:14.600451 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:14.600684 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:14.601418 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:14.601440 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:14.603670 (+ 2230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:14.607067 (+ 3397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:14.607078 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:14.607099 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:14.607559 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:14.607950 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:14.607956 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:14.607960 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:14.608163 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:14.608811 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:14.608819 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:14.609185 (+ 366us) client_negotiation.cc:769] Sending connection context
0924 12:52:14.609467 (+ 282us) client_negotiation.cc:240] Negotiation successful
0924 12:52:14.610061 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":403,"threads_started":1}
I20260924 12:52:14.613409 12360 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38561
I20260924 12:52:14.613952 12360 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:14.615207 12360 heartbeater.cc:511] Master 127.11.49.126:38561 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
I20260924 12:52:14.617604 12037 ts_manager.cc:194] Registered new tserver with Master: 3daab7362912461fbd283832dc5ec6e0 (127.11.49.66:38063)
I20260924 12:52:14.618616 12037 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:36145
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:52:14.648491 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38561
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:52:14.997512 12226 heartbeater.cc:503] Master 127.11.49.126:38561 was elected leader, sending a full tablet report...
W20260924 12:52:15.072953 12366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:15.073412 12366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:15.073611 12366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:15.082086 12366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:15.082294 12366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:15.082509 12366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:52:15.094348 12366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38561
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:15.096235 12366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:15.098033 12366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:15.115248 12372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:15.115301 12374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:15.115381 12371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:15.116155 12366 server_base.cc:1034] running on GCE node
I20260924 12:52:15.117102 12366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:15.118463 12366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:15.119762 12366 hybrid_clock.cc:648] HybridClock initialized: now 1790254335119702 us; error 53 us; skew 500 ppm
I20260924 12:52:15.120198 12366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:15 dist-test-slave-m9hg krb5kdc[11992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:15.124240 12366 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:52:15.126791 12366 webserver.cc:460] Webserver started at http://127.11.49.67:46437/ using document root <none> and password file <none>
I20260924 12:52:15.127763 12366 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:15.127942 12366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:15.128410 12366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:15.132444 12366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "8cd1836db05d457b9527bcdcbdd9faee"
format_stamp: "Formatted at 2026-09-24 12:52:15 on dist-test-slave-m9hg"
server_key: "cf0bdc3d9a02e570148f417fcf6768b8"
server_key_iv: "b8fb8d808ce9b515688fb14a748048f2"
server_key_version: "encryptionkey@0"
I20260924 12:52:15.133550 12366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "8cd1836db05d457b9527bcdcbdd9faee"
format_stamp: "Formatted at 2026-09-24 12:52:15 on dist-test-slave-m9hg"
server_key: "cf0bdc3d9a02e570148f417fcf6768b8"
server_key_iv: "b8fb8d808ce9b515688fb14a748048f2"
server_key_version: "encryptionkey@0"
I20260924 12:52:15.140658 12366 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260924 12:52:15.145756 12381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:15.147814 12366 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260924 12:52:15.148106 12366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "8cd1836db05d457b9527bcdcbdd9faee"
format_stamp: "Formatted at 2026-09-24 12:52:15 on dist-test-slave-m9hg"
server_key: "cf0bdc3d9a02e570148f417fcf6768b8"
server_key_iv: "b8fb8d808ce9b515688fb14a748048f2"
server_key_version: "encryptionkey@0"
I20260924 12:52:15.148490 12366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:15.171236 12366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:15.177073 12366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:15.177464 12366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:15.178777 12366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:15.180639 12366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:15.180751 12366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:15.180922 12366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:15.181001 12366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:15.222886 12366 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:43543
I20260924 12:52:15.222965 12493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:43543 every 8 connection(s)
I20260924 12:52:15.224623 12366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:52:15.231961 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 12366
I20260924 12:52:15.232242 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:52:15.232865 11461 external_mini_cluster.cc:1428] Setting key e521f617b028cf5a3ea56b55e54d4292
Sep 24 12:52:15 dist-test-slave-m9hg krb5kdc[11992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:15.250509 12496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.227844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:47115 (local address 127.11.49.126:38561)
0924 12:52:15.228530 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.228536 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.229516 (+ 980us) server_negotiation.cc:407] Connection header received
0924 12:52:15.231848 (+ 2332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.231854 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.231948 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.232083 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:15.234718 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.235698 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.238101 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.238562 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.238684 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.243410 (+ 4726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:15.243415 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:15.243419 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:15.243461 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:15.246335 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.247505 (+ 1170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.247509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.247512 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.247633 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.248263 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.248296 (+ 33us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.248299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.248605 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:15.248799 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.249818 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.250043 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":305,"threads_started":1}
I20260924 12:52:15.251624 12497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.228391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38561 (local address 127.11.49.67:47115)
0924 12:52:15.229263 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:15.229329 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:15.231337 (+ 2008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:15.232533 (+ 1196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:15.232550 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:15.233509 (+ 959us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:15.234396 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.234428 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.235899 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.235906 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.237898 (+ 1992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.237915 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.238823 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.238828 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.239118 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.239990 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:15.240050 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:15.243070 (+ 3020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:15.246575 (+ 3505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:15.246588 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:15.246609 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:15.247306 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:15.247767 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:15.247772 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:15.247776 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:15.248099 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:15.248855 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:15.248873 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:15.249414 (+ 541us) client_negotiation.cc:769] Sending connection context
0924 12:52:15.249734 (+ 320us) client_negotiation.cc:240] Negotiation successful
0924 12:52:15.250349 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":361,"threads_started":1}
I20260924 12:52:15.253449 12494 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38561
I20260924 12:52:15.253851 12494 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:15.254736 12494 heartbeater.cc:511] Master 127.11.49.126:38561 requested a full tablet report, sending...
I20260924 12:52:15.256479 12037 ts_manager.cc:194] Registered new tserver with Master: 8cd1836db05d457b9527bcdcbdd9faee (127.11.49.67:43543)
I20260924 12:52:15.257372 12037 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:47115
I20260924 12:52:15.264097 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:52:15.286933 12496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.272079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54306 (local address 127.11.49.126:38561)
0924 12:52:15.272414 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.272420 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.273173 (+ 753us) server_negotiation.cc:407] Connection header received
0924 12:52:15.273434 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.273439 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.273527 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.273650 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:15.275346 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.276175 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.277675 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.278125 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.278284 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.281001 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:15.281007 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:15.281011 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:15.281049 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:15.283925 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.284732 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.284740 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.284743 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.284877 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.285299 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.285312 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.285315 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.285649 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:15.285909 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.286325 (+ 416us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.286589 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260924 12:52:15.295802 12037 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:52:15.303509 12037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:52:15.334303 12507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.319868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:43113 (local address 127.0.0.1:39354)
0924 12:52:15.321084 (+ 1216us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:15.321159 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:15.321435 (+ 276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:15.323487 (+ 2052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:15.323500 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:15.323550 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:15.324109 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.324127 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.327185 (+ 3058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.327195 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.330593 (+ 3398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.330626 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.333050 (+ 2424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.333058 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.333327 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.333403 (+ 76us) client_negotiation.cc:769] Sending connection context
0924 12:52:15.333530 (+ 127us) client_negotiation.cc:240] Negotiation successful
0924 12:52:15.333789 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":454,"threads_started":1}
I20260924 12:52:15.334810 12508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.320012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39354 (local address 127.11.49.65:43113)
0924 12:52:15.322531 (+ 2519us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.322544 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.322580 (+ 36us) server_negotiation.cc:407] Connection header received
0924 12:52:15.322717 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.322729 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.323138 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.324449 (+ 1311us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:15.324790 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.326934 (+ 2144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.330957 (+ 4023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.332760 (+ 1803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.333790 (+ 1030us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.334111 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.334230 (+ 119us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.334450 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2257,"thread_start_us":2008,"threads_started":1}
I20260924 12:52:15.338593 12510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.320779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:38063 (local address 127.0.0.1:33038)
0924 12:52:15.329578 (+ 8799us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:15.329600 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:15.329767 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:15.331215 (+ 1448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:15.331220 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:15.331244 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:15.331629 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.331640 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.333551 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.333555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.335560 (+ 2005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.335573 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.337648 (+ 2075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.337655 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.337835 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.337879 (+ 44us) client_negotiation.cc:769] Sending connection context
0924 12:52:15.337985 (+ 106us) client_negotiation.cc:240] Negotiation successful
0924 12:52:15.338172 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8659,"mutex_wait_us":3,"thread_start_us":9798,"threads_started":1}
I20260924 12:52:15.339006 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.321874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33038 (local address 127.11.49.66:38063)
0924 12:52:15.328985 (+ 7111us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.328998 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.330542 (+ 1544us) server_negotiation.cc:407] Connection header received
0924 12:52:15.330682 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.330691 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.331012 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.331222 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:15.331792 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.333397 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.335747 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.337189 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.337318 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.337513 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.338110 (+ 597us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.338343 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6913,"thread_start_us":6794,"threads_started":1}
I20260924 12:52:15.340071 12509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.321429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:43543 (local address 127.0.0.1:53078)
0924 12:52:15.330908 (+ 9479us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:15.330927 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:15.331055 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:15.331834 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:15.331841 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:15.331873 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:15.332206 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.332218 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.334212 (+ 1994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.334221 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.337123 (+ 2902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.337141 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.339135 (+ 1994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.339142 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.339329 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.339393 (+ 64us) client_negotiation.cc:769] Sending connection context
0924 12:52:15.339480 (+ 87us) client_negotiation.cc:240] Negotiation successful
0924 12:52:15.339724 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9346,"mutex_wait_us":4,"thread_start_us":7665,"threads_started":1}
I20260924 12:52:15.340514 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.322567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53078 (local address 127.11.49.67:43543)
0924 12:52:15.330400 (+ 7833us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.330409 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.331065 (+ 656us) server_negotiation.cc:407] Connection header received
0924 12:52:15.331219 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.331228 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.331544 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.331788 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:15.332438 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.333996 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.337345 (+ 3349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.338906 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.339077 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.339304 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.339619 (+ 315us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.339831 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7650,"thread_start_us":7475,"threads_started":1}
I20260924 12:52:15.339967 12161 tablet_service.cc:1467] Processing CreateTablet for tablet cb9e3abe6d8b4f2cbcbcc9e446e351ac (DEFAULT_TABLE table=test-table [id=4af7d783b60b427dac95fe64dbb32d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:15.343443 12161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb9e3abe6d8b4f2cbcbcc9e446e351ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:15.343922 12295 tablet_service.cc:1467] Processing CreateTablet for tablet cb9e3abe6d8b4f2cbcbcc9e446e351ac (DEFAULT_TABLE table=test-table [id=4af7d783b60b427dac95fe64dbb32d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:15.344451 12429 tablet_service.cc:1467] Processing CreateTablet for tablet cb9e3abe6d8b4f2cbcbcc9e446e351ac (DEFAULT_TABLE table=test-table [id=4af7d783b60b427dac95fe64dbb32d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:15.345700 12295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb9e3abe6d8b4f2cbcbcc9e446e351ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:15.346122 12429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb9e3abe6d8b4f2cbcbcc9e446e351ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:15.360200 12513 tablet_bootstrap.cc:492] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee: Bootstrap starting.
I20260924 12:52:15.362092 12515 tablet_bootstrap.cc:492] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0: Bootstrap starting.
I20260924 12:52:15.364200 12513 tablet_bootstrap.cc:654] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:15.364559 12514 tablet_bootstrap.cc:492] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff: Bootstrap starting.
I20260924 12:52:15.365693 12515 tablet_bootstrap.cc:654] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:15.365792 12513 log.cc:824] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:15.366986 12515 log.cc:824] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:15.369023 12514 tablet_bootstrap.cc:654] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:15.370142 12513 tablet_bootstrap.cc:492] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee: No bootstrap required, opened a new log
I20260924 12:52:15.370466 12513 ts_tablet_manager.cc:1397] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260924 12:52:15.370638 12514 log.cc:824] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:15.371806 12515 tablet_bootstrap.cc:492] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0: No bootstrap required, opened a new log
I20260924 12:52:15.372152 12515 ts_tablet_manager.cc:1397] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260924 12:52:15.374562 12514 tablet_bootstrap.cc:492] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff: No bootstrap required, opened a new log
I20260924 12:52:15.374910 12514 ts_tablet_manager.cc:1397] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260924 12:52:15.378434 12513 raft_consensus.cc:348] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67134c32c5c041a2a03be2cdeeb40bff" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 43113 } } peers { permanent_uuid: "8cd1836db05d457b9527bcdcbdd9faee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43543 } } peers { permanent_uuid: "3daab7362912461fbd283832dc5ec6e0" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38063 } }
I20260924 12:52:15.378858 12513 raft_consensus.cc:374] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:15.378949 12513 raft_consensus.cc:729] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd1836db05d457b9527bcdcbdd9faee, State: Initialized, Role: FOLLOWER
I20260924 12:52:15.379684 12513 consensus_queue.cc:260] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67134c32c5c041a2a03be2cdeeb40bff" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 43113 } } peers { permanent_uuid: "8cd1836db05d457b9527bcdcbdd9faee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43543 } } peers { permanent_uuid: "3daab7362912461fbd283832dc5ec6e0" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38063 } }
I20260924 12:52:15.382153 12494 heartbeater.cc:503] Master 127.11.49.126:38561 was elected leader, sending a full tablet report...
I20260924 12:52:15.385444 12513 ts_tablet_manager.cc:1428] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee: Time spent starting tablet: real 0.015s user 0.008s sys 0.003s
I20260924 12:52:15.385569 12515 raft_consensus.cc:348] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67134c32c5c041a2a03be2cdeeb40bff" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 43113 } } peers { permanent_uuid: "8cd1836db05d457b9527bcdcbdd9faee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43543 } } peers { permanent_uuid: "3daab7362912461fbd283832dc5ec6e0" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38063 } }
I20260924 12:52:15.386224 12515 raft_consensus.cc:374] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:15.386327 12515 raft_consensus.cc:729] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3daab7362912461fbd283832dc5ec6e0, State: Initialized, Role: FOLLOWER
I20260924 12:52:15.387475 12515 consensus_queue.cc:260] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67134c32c5c041a2a03be2cdeeb40bff" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 43113 } } peers { permanent_uuid: "8cd1836db05d457b9527bcdcbdd9faee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43543 } } peers { permanent_uuid: "3daab7362912461fbd283832dc5ec6e0" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38063 } }
I20260924 12:52:15.389072 12514 raft_consensus.cc:348] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67134c32c5c041a2a03be2cdeeb40bff" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 43113 } } peers { permanent_uuid: "8cd1836db05d457b9527bcdcbdd9faee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43543 } } peers { permanent_uuid: "3daab7362912461fbd283832dc5ec6e0" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38063 } }
I20260924 12:52:15.389930 12514 raft_consensus.cc:374] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:15.390075 12514 raft_consensus.cc:729] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67134c32c5c041a2a03be2cdeeb40bff, State: Initialized, Role: FOLLOWER
I20260924 12:52:15.391445 12360 heartbeater.cc:503] Master 127.11.49.126:38561 was elected leader, sending a full tablet report...
I20260924 12:52:15.392251 12515 ts_tablet_manager.cc:1428] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0: Time spent starting tablet: real 0.020s user 0.007s sys 0.012s
I20260924 12:52:15.394536 12514 consensus_queue.cc:260] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67134c32c5c041a2a03be2cdeeb40bff" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 43113 } } peers { permanent_uuid: "8cd1836db05d457b9527bcdcbdd9faee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43543 } } peers { permanent_uuid: "3daab7362912461fbd283832dc5ec6e0" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38063 } }
I20260924 12:52:15.399524 12514 ts_tablet_manager.cc:1428] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff: Time spent starting tablet: real 0.024s user 0.020s sys 0.000s
W20260924 12:52:15.458432 12227 tablet.cc:2369] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:52:15.467499 12519 raft_consensus.cc:482] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:52:15.467931 12519 raft_consensus.cc:504] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67134c32c5c041a2a03be2cdeeb40bff" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 43113 } } peers { permanent_uuid: "8cd1836db05d457b9527bcdcbdd9faee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43543 } } peers { permanent_uuid: "3daab7362912461fbd283832dc5ec6e0" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38063 } }
I20260924 12:52:15.470214 12519 leader_election.cc:288] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67134c32c5c041a2a03be2cdeeb40bff (127.11.49.65:43113), 3daab7362912461fbd283832dc5ec6e0 (127.11.49.66:38063)
W20260924 12:52:15.476694 12495 tablet.cc:2369] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:52:15.477797 12497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.470814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:43113 (local address 127.11.49.67:53513)
0924 12:52:15.471026 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:15.471049 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:15.471187 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:15.471708 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:15.471721 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:15.471769 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:15.472128 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.472143 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.473516 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.473520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.475468 (+ 1948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.475484 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.476891 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.476897 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.477130 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.477172 (+ 42us) client_negotiation.cc:769] Sending connection context
0924 12:52:15.477297 (+ 125us) client_negotiation.cc:240] Negotiation successful
0924 12:52:15.477457 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":31}
I20260924 12:52:15.477787 12508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.470938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:53513 (local address 127.11.49.65:43113)
0924 12:52:15.471279 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.471287 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.471309 (+ 22us) server_negotiation.cc:407] Connection header received
0924 12:52:15.471394 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.471401 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.471487 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.471599 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:15.472411 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.473379 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.475657 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.476684 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.476872 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.476946 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.477353 (+ 407us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.477496 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260924 12:52:15.478662 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.470955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:34699 (local address 127.11.49.66:38063)
0924 12:52:15.471176 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.471181 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.472384 (+ 1203us) server_negotiation.cc:407] Connection header received
0924 12:52:15.472671 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.472678 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.472784 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.472904 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:15.473410 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.474150 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.476367 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.477546 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.477697 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.477767 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.478339 (+ 572us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.478465 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260924 12:52:15.478878 12522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.470814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:38063 (local address 127.11.49.67:34699)
0924 12:52:15.472248 (+ 1434us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:15.472298 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:15.472494 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:15.472922 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:15.472926 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:15.472943 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:15.473246 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.473253 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.474319 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.474325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.476148 (+ 1823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:15.476159 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.477971 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.477977 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:15.478166 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.478192 (+ 26us) client_negotiation.cc:769] Sending connection context
0924 12:52:15.478307 (+ 115us) client_negotiation.cc:240] Negotiation successful
0924 12:52:15.478458 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1285,"mutex_wait_us":466,"thread_start_us":457,"threads_started":1}
I20260924 12:52:15.479543 12181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb9e3abe6d8b4f2cbcbcc9e446e351ac" candidate_uuid: "8cd1836db05d457b9527bcdcbdd9faee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67134c32c5c041a2a03be2cdeeb40bff" is_pre_election: true
I20260924 12:52:15.480140 12315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb9e3abe6d8b4f2cbcbcc9e446e351ac" candidate_uuid: "8cd1836db05d457b9527bcdcbdd9faee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3daab7362912461fbd283832dc5ec6e0" is_pre_election: true
I20260924 12:52:15.480229 12181 raft_consensus.cc:2454] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd1836db05d457b9527bcdcbdd9faee in term 0.
I20260924 12:52:15.480726 12315 raft_consensus.cc:2454] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd1836db05d457b9527bcdcbdd9faee in term 0.
I20260924 12:52:15.481244 12385 leader_election.cc:302] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67134c32c5c041a2a03be2cdeeb40bff, 8cd1836db05d457b9527bcdcbdd9faee; no voters:
I20260924 12:52:15.481779 12519 raft_consensus.cc:2781] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:52:15.481925 12519 raft_consensus.cc:482] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:52:15.482069 12519 raft_consensus.cc:3037] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:15.484629 12519 raft_consensus.cc:504] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67134c32c5c041a2a03be2cdeeb40bff" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 43113 } } peers { permanent_uuid: "8cd1836db05d457b9527bcdcbdd9faee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43543 } } peers { permanent_uuid: "3daab7362912461fbd283832dc5ec6e0" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38063 } }
I20260924 12:52:15.485432 12519 leader_election.cc:288] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [CANDIDATE]: Term 1 election: Requested vote from peers 67134c32c5c041a2a03be2cdeeb40bff (127.11.49.65:43113), 3daab7362912461fbd283832dc5ec6e0 (127.11.49.66:38063)
I20260924 12:52:15.486012 12181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb9e3abe6d8b4f2cbcbcc9e446e351ac" candidate_uuid: "8cd1836db05d457b9527bcdcbdd9faee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67134c32c5c041a2a03be2cdeeb40bff"
I20260924 12:52:15.486115 12315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb9e3abe6d8b4f2cbcbcc9e446e351ac" candidate_uuid: "8cd1836db05d457b9527bcdcbdd9faee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3daab7362912461fbd283832dc5ec6e0"
I20260924 12:52:15.486322 12315 raft_consensus.cc:3037] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:15.486321 12181 raft_consensus.cc:3037] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:15.489926 12315 raft_consensus.cc:2454] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd1836db05d457b9527bcdcbdd9faee in term 1.
I20260924 12:52:15.489926 12181 raft_consensus.cc:2454] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 67134c32c5c041a2a03be2cdeeb40bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd1836db05d457b9527bcdcbdd9faee in term 1.
I20260924 12:52:15.490557 12385 leader_election.cc:302] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3daab7362912461fbd283832dc5ec6e0, 67134c32c5c041a2a03be2cdeeb40bff, 8cd1836db05d457b9527bcdcbdd9faee; no voters:
I20260924 12:52:15.491108 12519 raft_consensus.cc:2781] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:15.491698 12519 raft_consensus.cc:686] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [term 1 LEADER]: Becoming Leader. State: Replica: 8cd1836db05d457b9527bcdcbdd9faee, State: Running, Role: LEADER
I20260924 12:52:15.492355 12519 consensus_queue.cc:237] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67134c32c5c041a2a03be2cdeeb40bff" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 43113 } } peers { permanent_uuid: "8cd1836db05d457b9527bcdcbdd9faee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43543 } } peers { permanent_uuid: "3daab7362912461fbd283832dc5ec6e0" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38063 } }
I20260924 12:52:15.497622 12035 catalog_manager.cc:5495] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 8cd1836db05d457b9527bcdcbdd9faee reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd1836db05d457b9527bcdcbdd9faee (127.11.49.67). New cstate: current_term: 1 leader_uuid: "8cd1836db05d457b9527bcdcbdd9faee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67134c32c5c041a2a03be2cdeeb40bff" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 43113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd1836db05d457b9527bcdcbdd9faee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3daab7362912461fbd283832dc5ec6e0" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38063 } health_report { overall_health: UNKNOWN } } }
Sep 24 12:52:15 dist-test-slave-m9hg krb5kdc[11992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:52:15.549299 12508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.526613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39370 (local address 127.11.49.65:43113)
0924 12:52:15.526941 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.526952 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.527578 (+ 626us) server_negotiation.cc:407] Connection header received
0924 12:52:15.527817 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.527826 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.527940 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.528072 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:15.530147 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.530989 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.532554 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.533056 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.533220 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.541679 (+ 8459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:15.541701 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:15.541722 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:15.541779 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:15.545741 (+ 3962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.546777 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.546787 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.546790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.546965 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.547413 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.547420 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.547428 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.547879 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:15.548237 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.548614 (+ 377us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.548883 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
Sep 24 12:52:15 dist-test-slave-m9hg krb5kdc[11992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254335, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260924 12:52:15.596827 12361 tablet.cc:2369] T cb9e3abe6d8b4f2cbcbcc9e446e351ac P 3daab7362912461fbd283832dc5ec6e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 24 12:52:15 dist-test-slave-m9hg krb5kdc[11992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254335, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:52:15.622587 12508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.603412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39384 (local address 127.11.49.65:43113)
0924 12:52:15.603729 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.603737 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.604035 (+ 298us) server_negotiation.cc:407] Connection header received
0924 12:52:15.605069 (+ 1034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.605075 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.605164 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.605287 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:15.607677 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.609127 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.611378 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.611944 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.612060 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.616907 (+ 4847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:15.616913 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:15.616916 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:15.616958 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:15.619742 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.620528 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.620534 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.620537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.620679 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.621105 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.621112 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.621115 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.621407 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:15.621705 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.621998 (+ 293us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.622230 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
Sep 24 12:52:15 dist-test-slave-m9hg krb5kdc[11992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 24 12:52:15 dist-test-slave-m9hg krb5kdc[11992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:52:15.674021 12508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.658756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39396 (local address 127.11.49.65:43113)
0924 12:52:15.658979 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.658987 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.659399 (+ 412us) server_negotiation.cc:407] Connection header received
0924 12:52:15.659639 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.659643 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.659705 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.659814 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:15.661252 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.661929 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.663186 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.663612 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.663748 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.668145 (+ 4397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:15.668150 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:15.668154 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:15.668190 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:15.671310 (+ 3120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.672007 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.672014 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.672017 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.672139 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.672531 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.672537 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.672541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.672850 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:15.673116 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.673404 (+ 288us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.673656 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260924 12:52:15.676405 12141 tablet_service.cc:2908] Rejecting scan request for tablet cb9e3abe6d8b4f2cbcbcc9e446e351ac: Uninitialized: clean time has not yet been initialized
I20260924 12:52:15.680769 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 12098
I20260924 12:52:15.695915 12508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.681859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39410 (local address 127.11.49.65:43113)
0924 12:52:15.682143 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.682150 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.682932 (+ 782us) server_negotiation.cc:407] Connection header received
0924 12:52:15.683171 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.683177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.683284 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.683366 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:15.685330 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.686148 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.687552 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.687981 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.688133 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.690678 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:15.690683 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:15.690686 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:15.690733 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:15.693262 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.693945 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.693957 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.693960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.694077 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.694449 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.694454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.694458 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.694745 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:15.695061 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.695333 (+ 272us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.695557 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
I20260924 12:52:15.696647 12221 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:15.792467 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 12098
I20260924 12:52:15.811712 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 12232
Sep 24 12:52:15 dist-test-slave-m9hg krb5kdc[11992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:52:15.830084 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.812717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33042 (local address 127.11.49.66:38063)
0924 12:52:15.812940 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.812949 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.812982 (+ 33us) server_negotiation.cc:407] Connection header received
0924 12:52:15.813250 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.813255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.813346 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.813470 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:15.814895 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.815768 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.817368 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.817833 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.817993 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.822884 (+ 4891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:15.822906 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:15.822927 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:15.822978 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:15.826591 (+ 3613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.827504 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.827513 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.827515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.827683 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.828115 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.828123 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.828130 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.828677 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:15.829064 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.829369 (+ 305us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.829658 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260924 12:52:15.831000 12355 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:15.931618 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 12232
I20260924 12:52:15.949954 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 12366
Sep 24 12:52:15 dist-test-slave-m9hg krb5kdc[11992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:52:15.966159 12538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:15.950805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53080 (local address 127.11.49.67:43543)
0924 12:52:15.951359 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:15.951364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:15.951386 (+ 22us) server_negotiation.cc:407] Connection header received
0924 12:52:15.951461 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:15.951465 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:15.951560 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:15.951680 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:15.953198 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.954017 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.955367 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:15.955790 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:15.955930 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:15.960226 (+ 4296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:15.960239 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:15.960256 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:15.960343 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:15.963256 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.963937 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.963944 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.963947 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.964088 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:15.964628 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:15.964636 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:15.964642 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:15.964978 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:15.965289 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:15.965525 (+ 236us) server_negotiation.cc:299] Negotiation successful
0924 12:52:15.965739 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":279,"threads_started":1}
I20260924 12:52:15.967116 12489 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:16.062495 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 12366
I20260924 12:52:16.079385 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 12005
I20260924 12:52:16.080933 12067 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:16.207037 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 12005
2026-09-24T12:52:16Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4905 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:52:16 dist-test-slave-m9hg krb5kdc[12544](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:52:16 dist-test-slave-m9hg krb5kdc[12544](info): set up 2 sockets
Sep 24 12:52:16 dist-test-slave-m9hg krb5kdc[12544](info): commencing operation
krb5kdc: starting...
W20260924 12:52:17.353281 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.003s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:52:17 dist-test-slave-m9hg krb5kdc[12544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:52:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:52:17.576995 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:39889
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:46153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:39889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:17.928056 12557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:17.928471 12557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:17.928608 12557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:17.936079 12557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:17.936259 12557 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260924 12:52:17.936388 12557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:17.936510 12557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:17.936591 12557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:17.936681 12557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:52:17.946986 12557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:46153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:39889
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:39889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:17.948426 12557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:17.949827 12557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:17.963375 12562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:17.963500 12563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:17.963500 12565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:17.965708 12557 server_base.cc:1034] running on GCE node
I20260924 12:52:17.966614 12557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:17.968236 12557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:17.969599 12557 hybrid_clock.cc:648] HybridClock initialized: now 1790254337969494 us; error 72 us; skew 500 ppm
I20260924 12:52:17.970067 12557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:17 dist-test-slave-m9hg krb5kdc[12544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254337, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:17.973929 12557 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:52:17.975852 12557 webserver.cc:460] Webserver started at http://127.11.49.126:46533/ using document root <none> and password file <none>
I20260924 12:52:17.976752 12557 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:17.976897 12557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:17.977241 12557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:17.980480 12557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "0fed5b513594425fbd5aed0e2ae65f3e"
format_stamp: "Formatted at 2026-09-24 12:52:17 on dist-test-slave-m9hg"
server_key: "55cbdf630190e5934db6e02eeef4e831"
server_key_iv: "7dfac354c69344eb4ecacef972084122"
server_key_version: "encryptionkey@0"
I20260924 12:52:17.981410 12557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "0fed5b513594425fbd5aed0e2ae65f3e"
format_stamp: "Formatted at 2026-09-24 12:52:17 on dist-test-slave-m9hg"
server_key: "55cbdf630190e5934db6e02eeef4e831"
server_key_iv: "7dfac354c69344eb4ecacef972084122"
server_key_version: "encryptionkey@0"
I20260924 12:52:17.987493 12557 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260924 12:52:17.992130 12572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:17.994165 12557 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:52:17.994426 12557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "0fed5b513594425fbd5aed0e2ae65f3e"
format_stamp: "Formatted at 2026-09-24 12:52:17 on dist-test-slave-m9hg"
server_key: "55cbdf630190e5934db6e02eeef4e831"
server_key_iv: "7dfac354c69344eb4ecacef972084122"
server_key_version: "encryptionkey@0"
I20260924 12:52:17.994683 12557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:18.034513 12557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:18.039471 12557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:18.039755 12557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:18.065587 12557 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:39889
I20260924 12:52:18.065606 12633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:39889 every 8 connection(s)
I20260924 12:52:18.066982 12557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:18.072017 12634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:18.072727 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 12557
I20260924 12:52:18.073001 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:18.073693 11461 external_mini_cluster.cc:1428] Setting key 7fe1f5492bbacfb9679cca04c4dec21b
I20260924 12:52:18.089008 12634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e: Bootstrap starting.
Sep 24 12:52:18 dist-test-slave-m9hg krb5kdc[12544](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:18.093969 12634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:18.095638 12634 log.cc:824] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:18.099907 12634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e: No bootstrap required, opened a new log
I20260924 12:52:18.100490 12637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:18.076218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40710 (local address 127.11.49.126:39889)
0924 12:52:18.077379 (+ 1161us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:18.077393 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:18.077448 (+ 55us) server_negotiation.cc:407] Connection header received
0924 12:52:18.080026 (+ 2578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:18.080053 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:18.080627 (+ 574us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:18.081128 (+ 501us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:18.082643 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:18.084067 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:18.085383 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:18.086172 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:18.086416 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:18.090850 (+ 4434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:18.090862 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:18.090879 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:18.090935 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:18.094755 (+ 3820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:18.095914 (+ 1159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:18.095922 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:18.095931 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:18.096182 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:18.097023 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:18.097031 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:18.097037 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:18.097791 (+ 754us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:18.098040 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:18.098786 (+ 746us) server_negotiation.cc:299] Negotiation successful
0924 12:52:18.099241 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":882,"thread_start_us":504,"threads_started":1}
I20260924 12:52:18.110811 12634 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fed5b513594425fbd5aed0e2ae65f3e" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39889 } }
I20260924 12:52:18.111501 12634 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:18.111719 12634 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fed5b513594425fbd5aed0e2ae65f3e, State: Initialized, Role: FOLLOWER
I20260924 12:52:18.112601 12634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fed5b513594425fbd5aed0e2ae65f3e" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39889 } }
I20260924 12:52:18.112921 12634 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:18.113087 12634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:18.113305 12634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:18.115962 12634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fed5b513594425fbd5aed0e2ae65f3e" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39889 } }
I20260924 12:52:18.116842 12634 leader_election.cc:302] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fed5b513594425fbd5aed0e2ae65f3e; no voters:
I20260924 12:52:18.117702 12634 leader_election.cc:288] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:18.117847 12639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:18.118801 12639 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [term 1 LEADER]: Becoming Leader. State: Replica: 0fed5b513594425fbd5aed0e2ae65f3e, State: Running, Role: LEADER
I20260924 12:52:18.119544 12639 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fed5b513594425fbd5aed0e2ae65f3e" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39889 } }
I20260924 12:52:18.120553 12634 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:18.122658 12641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fed5b513594425fbd5aed0e2ae65f3e. Latest consensus state: current_term: 1 leader_uuid: "0fed5b513594425fbd5aed0e2ae65f3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fed5b513594425fbd5aed0e2ae65f3e" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39889 } } }
I20260924 12:52:18.122690 12640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fed5b513594425fbd5aed0e2ae65f3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fed5b513594425fbd5aed0e2ae65f3e" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39889 } } }
I20260924 12:52:18.123178 12640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:18.123318 12641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:18.124173 12644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:18.129901 12644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:18.139779 12644 catalog_manager.cc:1347] Generated new cluster ID: ef53daa2b40640ccb762a915a070fc87
I20260924 12:52:18.139930 12644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:18.156708 12644 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:18.158061 12644 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:18.179349 12644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e: Generated new TSK 0
I20260924 12:52:18.180346 12644 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:52:18.239619 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:39889
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:46153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:18.573329 12660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:18.573642 12660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:18.573741 12660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:18.581233 12660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:18.581365 12660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:18.581450 12660 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 12:52:18.581524 12660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:52:18.591605 12660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:46153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.49.126:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:18.593003 12660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:18.594313 12660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:18.609728 12668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:18.609624 12666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:18.609824 12665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:18.611279 12660 server_base.cc:1034] running on GCE node
I20260924 12:52:18.612218 12660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:18.613586 12660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:18.614877 12660 hybrid_clock.cc:648] HybridClock initialized: now 1790254338614757 us; error 75 us; skew 500 ppm
I20260924 12:52:18.615264 12660 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:18 dist-test-slave-m9hg krb5kdc[12544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254338, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:18.619742 12660 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:52:18.622318 12660 webserver.cc:460] Webserver started at http://127.11.49.65:39945/ using document root <none> and password file <none>
I20260924 12:52:18.623335 12660 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:18.623498 12660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:18.623997 12660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:18.628013 12660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "3237a3d71c0048a8a74e04f0bfaa40e3"
format_stamp: "Formatted at 2026-09-24 12:52:18 on dist-test-slave-m9hg"
server_key: "fdab5ec6120a03c991a7da36cd1845cb"
server_key_iv: "fcae2dfa4c3a516ce4b341327a25b10a"
server_key_version: "encryptionkey@0"
I20260924 12:52:18.629226 12660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "3237a3d71c0048a8a74e04f0bfaa40e3"
format_stamp: "Formatted at 2026-09-24 12:52:18 on dist-test-slave-m9hg"
server_key: "fdab5ec6120a03c991a7da36cd1845cb"
server_key_iv: "fcae2dfa4c3a516ce4b341327a25b10a"
server_key_version: "encryptionkey@0"
I20260924 12:52:18.636793 12660 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260924 12:52:18.641999 12675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:18.644122 12660 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.001s
I20260924 12:52:18.644467 12660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "3237a3d71c0048a8a74e04f0bfaa40e3"
format_stamp: "Formatted at 2026-09-24 12:52:18 on dist-test-slave-m9hg"
server_key: "fdab5ec6120a03c991a7da36cd1845cb"
server_key_iv: "fcae2dfa4c3a516ce4b341327a25b10a"
server_key_version: "encryptionkey@0"
I20260924 12:52:18.644784 12660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:18.679760 12660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:18.686156 12660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:18.686560 12660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:18.690387 12660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:18.690534 12660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:18.690879 12660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:18.691035 12660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 12:52:18 dist-test-slave-m9hg krb5kdc[12544](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254338, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:18.719735 12685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:18.692100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39889 (local address 127.11.49.65:57971)
0924 12:52:18.693389 (+ 1289us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:18.693439 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:18.695736 (+ 2297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:18.697077 (+ 1341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:18.697094 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:18.698078 (+ 984us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:18.699360 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:18.699392 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:18.701007 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:18.701013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:18.703738 (+ 2725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:18.703764 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:18.704988 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:18.704996 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:18.705364 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:18.706277 (+ 913us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:18.706318 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:18.709769 (+ 3451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:18.713951 (+ 4182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:18.713960 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:18.713979 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:18.714896 (+ 917us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:18.715428 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:18.715432 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:18.715435 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:18.715670 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:18.716243 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:18.716252 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:18.716824 (+ 572us) client_negotiation.cc:769] Sending connection context
0924 12:52:18.717211 (+ 387us) client_negotiation.cc:240] Negotiation successful
0924 12:52:18.717948 (+ 737us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":934,"thread_start_us":477,"threads_started":1}
I20260924 12:52:18.721028 12683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:18.691033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:57971 (local address 127.11.49.126:39889)
0924 12:52:18.691621 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:18.691630 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:18.693585 (+ 1955us) server_negotiation.cc:407] Connection header received
0924 12:52:18.696300 (+ 2715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:18.696309 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:18.696455 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:18.696671 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:18.699645 (+ 2974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:18.700783 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:18.704066 (+ 3283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:18.704699 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:18.704856 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:18.710104 (+ 5248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:18.710132 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:18.710139 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:18.710195 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:18.713771 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:18.715105 (+ 1334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:18.715113 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:18.715118 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:18.715273 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:18.715801 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:18.715807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:18.715810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:18.716092 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:18.716250 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:18.720490 (+ 4240us) server_negotiation.cc:299] Negotiation successful
0924 12:52:18.720730 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":318,"threads_started":1}
I20260924 12:52:18.747746 12758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:18.730477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39889 (local address 127.11.49.65:60655)
0924 12:52:18.731182 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:18.731200 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:18.731333 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:18.731922 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:18.731926 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:18.732533 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:18.733055 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:18.733077 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:18.734668 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:18.734674 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:18.736601 (+ 1927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:18.736616 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:18.737447 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:18.737455 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:18.737670 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:18.738720 (+ 1050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:18.738749 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:18.739825 (+ 1076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:18.743593 (+ 3768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:18.743599 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:18.743604 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:18.744400 (+ 796us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:18.744823 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:18.744830 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:18.744835 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:18.745025 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:18.745799 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:18.745806 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:18.746035 (+ 229us) client_negotiation.cc:769] Sending connection context
0924 12:52:18.746232 (+ 197us) client_negotiation.cc:240] Negotiation successful
0924 12:52:18.746929 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":368,"threads_started":1}
I20260924 12:52:18.748693 12683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:18.730652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:60655 (local address 127.11.49.126:39889)
0924 12:52:18.730971 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:18.730981 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:18.731310 (+ 329us) server_negotiation.cc:407] Connection header received
0924 12:52:18.731501 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:18.731511 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:18.731648 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:18.731861 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:18.733373 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:18.734524 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:18.736794 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:18.737239 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:18.737377 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:18.740057 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:18.740062 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:18.740065 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:18.740098 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:18.743407 (+ 3309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:18.744548 (+ 1141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:18.744555 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:18.744558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:18.744701 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:18.745184 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:18.745191 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:18.745195 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:18.745552 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:18.745716 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:18.747881 (+ 2165us) server_negotiation.cc:299] Negotiation successful
0924 12:52:18.748218 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260924 12:52:18.755937 12660 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:40333
I20260924 12:52:18.755949 12795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:40333 every 8 connection(s)
I20260924 12:52:18.757668 12660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:52:18.760699 12796 heartbeater.cc:347] Connected to a master server at 127.11.49.126:39889
I20260924 12:52:18.761089 12796 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:18.761509 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 12660
I20260924 12:52:18.761736 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:52:18.762066 12796 heartbeater.cc:511] Master 127.11.49.126:39889 requested a full tablet report, sending...
I20260924 12:52:18.762581 11461 external_mini_cluster.cc:1428] Setting key d78174ec382029e3bb8df01ce7326fe1
I20260924 12:52:18.764736 12589 ts_manager.cc:194] Registered new tserver with Master: 3237a3d71c0048a8a74e04f0bfaa40e3 (127.11.49.65:40333)
I20260924 12:52:18.766307 12589 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:57971
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:52:18.813138 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:39889
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:46153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:19.223162 12800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:19.223657 12800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:19.223855 12800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:19.232532 12800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:19.232784 12800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:19.232975 12800 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 12:52:19.233136 12800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:52:19.244984 12800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:46153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.49.126:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:19.246841 12800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:19.248800 12800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:19.266455 12805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:19.266808 12806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:19.267242 12808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:19.267674 12800 server_base.cc:1034] running on GCE node
I20260924 12:52:19.268600 12800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:19.269878 12800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:19.271215 12800 hybrid_clock.cc:648] HybridClock initialized: now 1790254339271097 us; error 78 us; skew 500 ppm
I20260924 12:52:19.271699 12800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:19 dist-test-slave-m9hg krb5kdc[12544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254339, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:19.276129 12800 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:52:19.278596 12800 webserver.cc:460] Webserver started at http://127.11.49.66:41131/ using document root <none> and password file <none>
I20260924 12:52:19.279645 12800 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:19.279819 12800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:19.280264 12800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:19.284935 12800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "728d1642a4804705825b31d2494f6356"
format_stamp: "Formatted at 2026-09-24 12:52:19 on dist-test-slave-m9hg"
server_key: "2d0b729749ced4ccfb13d58ad31e5bca"
server_key_iv: "4ed2c6206016c1bf9081705f9a8265e2"
server_key_version: "encryptionkey@0"
I20260924 12:52:19.286125 12800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "728d1642a4804705825b31d2494f6356"
format_stamp: "Formatted at 2026-09-24 12:52:19 on dist-test-slave-m9hg"
server_key: "2d0b729749ced4ccfb13d58ad31e5bca"
server_key_iv: "4ed2c6206016c1bf9081705f9a8265e2"
server_key_version: "encryptionkey@0"
I20260924 12:52:19.293581 12800 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260924 12:52:19.299281 12815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:19.301534 12800 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260924 12:52:19.301846 12800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "728d1642a4804705825b31d2494f6356"
format_stamp: "Formatted at 2026-09-24 12:52:19 on dist-test-slave-m9hg"
server_key: "2d0b729749ced4ccfb13d58ad31e5bca"
server_key_iv: "4ed2c6206016c1bf9081705f9a8265e2"
server_key_version: "encryptionkey@0"
I20260924 12:52:19.302184 12800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:19.348838 12800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:19.354355 12800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:19.354698 12800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:19.358367 12800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:19.358477 12800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:19.358687 12800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:19.358758 12800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 12:52:19 dist-test-slave-m9hg krb5kdc[12544](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254339, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:19.391297 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:19.359361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:52963 (local address 127.11.49.126:39889)
0924 12:52:19.360053 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:19.360062 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:19.362050 (+ 1988us) server_negotiation.cc:407] Connection header received
0924 12:52:19.366206 (+ 4156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:19.366219 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:19.366378 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:19.366562 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:19.370480 (+ 3918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:19.371727 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:19.374642 (+ 2915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:19.375246 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:19.375409 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:19.382218 (+ 6809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:19.382230 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:19.382238 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:19.382311 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:19.386417 (+ 4106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:19.387795 (+ 1378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:19.387805 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:19.387810 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:19.388001 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:19.388747 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:19.388752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:19.388756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:19.389237 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:19.389400 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:19.390542 (+ 1142us) server_negotiation.cc:299] Negotiation successful
0924 12:52:19.390840 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":589,"threads_started":1}
I20260924 12:52:19.393047 12825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:19.360417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39889 (local address 127.11.49.66:52963)
0924 12:52:19.361737 (+ 1320us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:19.361814 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:19.365577 (+ 3763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:19.366985 (+ 1408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:19.367002 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:19.368561 (+ 1559us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:19.370055 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:19.370104 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:19.372007 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:19.372012 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:19.374391 (+ 2379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:19.374416 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:19.375861 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:19.375872 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:19.376475 (+ 603us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:19.377662 (+ 1187us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:19.377723 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:19.381771 (+ 4048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:19.386650 (+ 4879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:19.386663 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:19.386722 (+ 59us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:19.387551 (+ 829us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:19.388157 (+ 606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:19.388166 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:19.388171 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:19.388594 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:19.389366 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:19.389376 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:19.390042 (+ 666us) client_negotiation.cc:769] Sending connection context
0924 12:52:19.390445 (+ 403us) client_negotiation.cc:240] Negotiation successful
0924 12:52:19.391200 (+ 755us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":873,"thread_start_us":481,"threads_started":1}
I20260924 12:52:19.417533 12800 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:45993
I20260924 12:52:19.417554 12935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:45993 every 8 connection(s)
I20260924 12:52:19.418987 12800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:52:19.421887 12936 heartbeater.cc:347] Connected to a master server at 127.11.49.126:39889
I20260924 12:52:19.422258 12936 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:19.423501 12936 heartbeater.cc:511] Master 127.11.49.126:39889 requested a full tablet report, sending...
I20260924 12:52:19.424536 12916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:19.405288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39889 (local address 127.11.49.66:35131)
0924 12:52:19.406143 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:19.406171 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:19.406403 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:19.406982 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:19.406987 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:19.407756 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:19.408150 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:19.408164 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:19.409827 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:19.409836 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:19.411931 (+ 2095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:19.411959 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:19.413256 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:19.413263 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:19.413512 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:19.414850 (+ 1338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:19.414872 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:19.415944 (+ 1072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:19.420460 (+ 4516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:19.420467 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:19.420471 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:19.421163 (+ 692us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:19.421809 (+ 646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:19.421819 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:19.421833 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:19.422174 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:19.423118 (+ 944us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:19.423122 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:19.423448 (+ 326us) client_negotiation.cc:769] Sending connection context
0924 12:52:19.423653 (+ 205us) client_negotiation.cc:240] Negotiation successful
0924 12:52:19.424032 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":804,"threads_started":1}
I20260924 12:52:19.424651 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:19.405278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:35131 (local address 127.11.49.126:39889)
0924 12:52:19.405659 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:19.405672 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:19.406322 (+ 650us) server_negotiation.cc:407] Connection header received
0924 12:52:19.406716 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:19.406722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:19.406813 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:19.406959 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:19.408404 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:19.409572 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:19.412159 (+ 2587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:19.412951 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:19.414484 (+ 1533us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:19.416242 (+ 1758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:19.416252 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:19.416261 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:19.416358 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:19.420197 (+ 3839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:19.421403 (+ 1206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:19.421409 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:19.421417 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:19.421617 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:19.422342 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:19.422350 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:19.422354 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:19.422962 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:19.423156 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:19.423783 (+ 627us) server_negotiation.cc:299] Negotiation successful
0924 12:52:19.424140 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260924 12:52:19.425721 12589 ts_manager.cc:194] Registered new tserver with Master: 728d1642a4804705825b31d2494f6356 (127.11.49.66:45993)
I20260924 12:52:19.426697 12589 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:52963
I20260924 12:52:19.427469 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 12800
I20260924 12:52:19.427723 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:52:19.428210 11461 external_mini_cluster.cc:1428] Setting key 072158bd63e4fee6d139ffa0f93471e0
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:52:19.476888 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:39889
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:46153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:52:19.770982 12796 heartbeater.cc:503] Master 127.11.49.126:39889 was elected leader, sending a full tablet report...
W20260924 12:52:19.912123 12940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:19.912607 12940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:19.912725 12940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:19.921567 12940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:19.921738 12940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:19.921839 12940 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 12:52:19.921936 12940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:52:19.934201 12940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:46153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.49.126:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:19.936079 12940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:19.938004 12940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:19.957484 12948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:19.957523 12945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:19.957571 12946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:19.958757 12940 server_base.cc:1034] running on GCE node
I20260924 12:52:19.959615 12940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:19.961050 12940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:19.962399 12940 hybrid_clock.cc:648] HybridClock initialized: now 1790254339962316 us; error 49 us; skew 500 ppm
I20260924 12:52:19.962882 12940 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:19 dist-test-slave-m9hg krb5kdc[12544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254339, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:19.967229 12940 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:52:19.969592 12940 webserver.cc:460] Webserver started at http://127.11.49.67:37089/ using document root <none> and password file <none>
I20260924 12:52:19.970575 12940 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:19.970734 12940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:19.971143 12940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:19.974979 12940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "1720101a05324f5fadbb956b60b91dfe"
format_stamp: "Formatted at 2026-09-24 12:52:19 on dist-test-slave-m9hg"
server_key: "3c630c0588a17028baafcf3f2d201a1d"
server_key_iv: "55f8ea2baa17816f6e6c2a5644660bc0"
server_key_version: "encryptionkey@0"
I20260924 12:52:19.976565 12940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "1720101a05324f5fadbb956b60b91dfe"
format_stamp: "Formatted at 2026-09-24 12:52:19 on dist-test-slave-m9hg"
server_key: "3c630c0588a17028baafcf3f2d201a1d"
server_key_iv: "55f8ea2baa17816f6e6c2a5644660bc0"
server_key_version: "encryptionkey@0"
I20260924 12:52:19.984050 12940 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260924 12:52:19.989405 12955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:19.991567 12940 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260924 12:52:19.991882 12940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "1720101a05324f5fadbb956b60b91dfe"
format_stamp: "Formatted at 2026-09-24 12:52:19 on dist-test-slave-m9hg"
server_key: "3c630c0588a17028baafcf3f2d201a1d"
server_key_iv: "55f8ea2baa17816f6e6c2a5644660bc0"
server_key_version: "encryptionkey@0"
I20260924 12:52:19.992230 12940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:20.015460 12940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:20.021586 12940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:20.021999 12940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:20.025807 12940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:20.025976 12940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:20.026212 12940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:20.026283 12940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 12:52:20 dist-test-slave-m9hg krb5kdc[12544](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254339, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:20.059089 12964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.026423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:51937 (local address 127.11.49.126:39889)
0924 12:52:20.027410 (+ 987us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:20.027419 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:20.028569 (+ 1150us) server_negotiation.cc:407] Connection header received
0924 12:52:20.030950 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:20.030956 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:20.031076 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:20.031207 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:20.033985 (+ 2778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.035287 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.039458 (+ 4171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.040186 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.040387 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.048706 (+ 8319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:20.048713 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:20.048717 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:20.048769 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:20.053004 (+ 4235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:20.054813 (+ 1809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:20.054821 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:20.054828 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:20.055043 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:20.056215 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:20.056223 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:20.056228 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:20.056702 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:20.056882 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:20.058453 (+ 1571us) server_negotiation.cc:299] Negotiation successful
0924 12:52:20.058719 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":799,"thread_start_us":661,"threads_started":1}
I20260924 12:52:20.063490 12965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.027181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39889 (local address 127.11.49.67:51937)
0924 12:52:20.028334 (+ 1153us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:20.028398 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:20.030573 (+ 2175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:20.031482 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:20.031491 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:20.032439 (+ 948us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:20.033622 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.033654 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.035475 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.035484 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.039130 (+ 3646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.039165 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.040698 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.040719 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.041291 (+ 572us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.042675 (+ 1384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:20.042733 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:20.048074 (+ 5341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:20.053290 (+ 5216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:20.053307 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:20.053339 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:20.054585 (+ 1246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:20.055225 (+ 640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:20.055234 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:20.055240 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:20.055989 (+ 749us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:20.056892 (+ 903us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:20.056918 (+ 26us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:20.057805 (+ 887us) client_negotiation.cc:769] Sending connection context
0924 12:52:20.059552 (+ 1747us) client_negotiation.cc:240] Negotiation successful
0924 12:52:20.061051 (+ 1499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"thread_start_us":462,"threads_started":1}
I20260924 12:52:20.080372 12940 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:42893
I20260924 12:52:20.080500 13075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:42893 every 8 connection(s)
I20260924 12:52:20.081935 12940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:52:20.084921 13076 heartbeater.cc:347] Connected to a master server at 127.11.49.126:39889
I20260924 12:52:20.085292 13076 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:20.086377 13076 heartbeater.cc:511] Master 127.11.49.126:39889 requested a full tablet report, sending...
I20260924 12:52:20.088878 12589 ts_manager.cc:194] Registered new tserver with Master: 1720101a05324f5fadbb956b60b91dfe (127.11.49.67:42893)
I20260924 12:52:20.090009 12589 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:51937
I20260924 12:52:20.091398 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 12940
I20260924 12:52:20.091614 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:52:20.092178 11461 external_mini_cluster.cc:1428] Setting key 1649262fa28b5a029085e515070a3037
I20260924 12:52:20.096697 12964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.078231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:41339 (local address 127.11.49.126:39889)
0924 12:52:20.078454 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:20.078464 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:20.079709 (+ 1245us) server_negotiation.cc:407] Connection header received
0924 12:52:20.080160 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:20.080168 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:20.080323 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:20.080418 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:20.081835 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.082978 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.085575 (+ 2597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.086314 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.086503 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.089039 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:20.089045 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:20.089048 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:20.089115 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:20.092913 (+ 3798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:20.093853 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:20.093858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:20.093862 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:20.094021 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:20.094677 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:20.094683 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:20.094686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:20.095076 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:20.095263 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:20.095950 (+ 687us) server_negotiation.cc:299] Negotiation successful
0924 12:52:20.096379 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260924 12:52:20.096800 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:52:20.096918 13073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.078363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39889 (local address 127.11.49.67:41339)
0924 12:52:20.079520 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:20.079552 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:20.079895 (+ 343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:20.080708 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:20.080716 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:20.081293 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:20.081650 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.081662 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.083265 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.083281 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.085316 (+ 2035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.085378 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.086605 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.086611 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.086767 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.087766 (+ 999us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:20.087797 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:20.088770 (+ 973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:20.093079 (+ 4309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:20.093085 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:20.093089 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:20.093686 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:20.094211 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:20.094216 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:20.094220 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:20.094493 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:20.095272 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:20.095277 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:20.095545 (+ 268us) client_negotiation.cc:769] Sending connection context
0924 12:52:20.095820 (+ 275us) client_negotiation.cc:240] Negotiation successful
0924 12:52:20.096343 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":977,"thread_start_us":756,"threads_started":1}
Sep 24 12:52:20 dist-test-slave-m9hg krb5kdc[12544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254340, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 24 12:52:20 dist-test-slave-m9hg krb5kdc[12544](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254340, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:20.154794 12964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.137150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40722 (local address 127.11.49.126:39889)
0924 12:52:20.137383 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:20.137389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:20.137671 (+ 282us) server_negotiation.cc:407] Connection header received
0924 12:52:20.137908 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:20.137937 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:20.138027 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:20.138168 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:20.139970 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.140948 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.142531 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.143052 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.143193 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.147840 (+ 4647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:20.147847 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:20.147852 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:20.147909 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:20.151472 (+ 3563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:20.152410 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:20.152417 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:20.152420 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:20.152600 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:20.153077 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:20.153081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:20.153083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:20.153458 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:20.153764 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:20.154104 (+ 340us) server_negotiation.cc:299] Negotiation successful
0924 12:52:20.154317 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260924 12:52:20.160728 12589 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:52:20.167997 12589 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:52:20.219358 13094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.183500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:45993 (local address 127.0.0.1:54356)
0924 12:52:20.207006 (+ 23506us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:20.207048 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:20.207285 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:20.210294 (+ 3009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:20.210303 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:20.210347 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:20.210800 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.210814 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.213022 (+ 2208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.213028 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.216023 (+ 2995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.216035 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.218111 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.218118 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.218378 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.218442 (+ 64us) client_negotiation.cc:769] Sending connection context
0924 12:52:20.218595 (+ 153us) client_negotiation.cc:240] Negotiation successful
0924 12:52:20.218799 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23251,"mutex_wait_us":363,"thread_start_us":25959,"threads_started":1}
I20260924 12:52:20.219385 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.183838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54356 (local address 127.11.49.66:45993)
0924 12:52:20.209442 (+ 25604us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:20.209454 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:20.209493 (+ 39us) server_negotiation.cc:407] Connection header received
0924 12:52:20.209613 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:20.209622 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:20.209937 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:20.211012 (+ 1075us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:20.211227 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.212856 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.216193 (+ 3337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.217503 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.217731 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.217961 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:20.218721 (+ 760us) server_negotiation.cc:299] Negotiation successful
0924 12:52:20.218971 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25375,"thread_start_us":25205,"threads_started":1}
I20260924 12:52:20.220309 13089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.182965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:42893 (local address 127.0.0.1:44962)
0924 12:52:20.196695 (+ 13730us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:20.196786 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:20.197172 (+ 386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:20.211023 (+ 13851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:20.211029 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:20.211052 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:20.211495 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.211508 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.213868 (+ 2360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.213875 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.216651 (+ 2776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.216675 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.219423 (+ 2748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.219430 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.219623 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.219670 (+ 47us) client_negotiation.cc:769] Sending connection context
0924 12:52:20.219740 (+ 70us) client_negotiation.cc:240] Negotiation successful
0924 12:52:20.219891 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13220,"mutex_wait_us":22,"thread_start_us":12932,"threads_started":1}
I20260924 12:52:20.220609 13093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.184050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43228 (local address 127.11.49.65:40333)
0924 12:52:20.208387 (+ 24337us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:20.208401 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:20.210155 (+ 1754us) server_negotiation.cc:407] Connection header received
0924 12:52:20.210544 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:20.210554 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:20.210861 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:20.211106 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:20.212157 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.213549 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.217002 (+ 3453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.218534 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.218712 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.218939 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:20.220031 (+ 1092us) server_negotiation.cc:299] Negotiation successful
0924 12:52:20.220232 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24044,"thread_start_us":24350,"threads_started":1}
I20260924 12:52:20.221127 13090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.183537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40333 (local address 127.0.0.1:43228)
0924 12:52:20.209958 (+ 26421us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:20.209992 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:20.210287 (+ 295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:20.211469 (+ 1182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:20.211476 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:20.211498 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:20.211943 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.211958 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.213835 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.213843 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.216763 (+ 2920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.216778 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.219127 (+ 2349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.219135 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.219356 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.219406 (+ 50us) client_negotiation.cc:769] Sending connection context
0924 12:52:20.219966 (+ 560us) client_negotiation.cc:240] Negotiation successful
0924 12:52:20.220150 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26241,"mutex_wait_us":283,"thread_start_us":23999,"threads_started":1}
I20260924 12:52:20.221545 13091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.183488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44962 (local address 127.11.49.67:42893)
0924 12:52:20.210457 (+ 26969us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:20.210468 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:20.210502 (+ 34us) server_negotiation.cc:407] Connection header received
0924 12:52:20.210599 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:20.210606 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:20.210808 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:20.211716 (+ 908us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:20.212028 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.213675 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.216856 (+ 3181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.218298 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.220625 (+ 2327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.220942 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:20.221023 (+ 81us) server_negotiation.cc:299] Negotiation successful
0924 12:52:20.221235 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26779,"thread_start_us":27466,"threads_started":1}
I20260924 12:52:20.224689 12866 tablet_service.cc:1467] Processing CreateTablet for tablet eac885e3aa19494a8894ec7103c6b3fa (DEFAULT_TABLE table=test-table [id=3f2e65168a3747fdbf84a062f92859f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:20.225387 13006 tablet_service.cc:1467] Processing CreateTablet for tablet eac885e3aa19494a8894ec7103c6b3fa (DEFAULT_TABLE table=test-table [id=3f2e65168a3747fdbf84a062f92859f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:20.226426 12866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eac885e3aa19494a8894ec7103c6b3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:20.226799 13006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eac885e3aa19494a8894ec7103c6b3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:20.232452 12726 tablet_service.cc:1467] Processing CreateTablet for tablet eac885e3aa19494a8894ec7103c6b3fa (DEFAULT_TABLE table=test-table [id=3f2e65168a3747fdbf84a062f92859f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:20.234088 12726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eac885e3aa19494a8894ec7103c6b3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:20.241461 13095 tablet_bootstrap.cc:492] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: Bootstrap starting.
I20260924 12:52:20.245432 13096 tablet_bootstrap.cc:492] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: Bootstrap starting.
I20260924 12:52:20.246765 13095 tablet_bootstrap.cc:654] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:20.248685 13095 log.cc:824] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:20.250993 13096 tablet_bootstrap.cc:654] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:20.251791 13098 tablet_bootstrap.cc:492] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: Bootstrap starting.
I20260924 12:52:20.253094 13095 tablet_bootstrap.cc:492] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: No bootstrap required, opened a new log
I20260924 12:52:20.253345 13096 log.cc:824] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:20.253516 13095 ts_tablet_manager.cc:1397] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260924 12:52:20.255803 13098 tablet_bootstrap.cc:654] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:20.257202 13098 log.cc:824] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:20.257335 13096 tablet_bootstrap.cc:492] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: No bootstrap required, opened a new log
I20260924 12:52:20.257625 13096 ts_tablet_manager.cc:1397] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.008s
I20260924 12:52:20.260967 13098 tablet_bootstrap.cc:492] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: No bootstrap required, opened a new log
I20260924 12:52:20.261258 13098 ts_tablet_manager.cc:1397] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260924 12:52:20.264230 13095 raft_consensus.cc:348] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } }
I20260924 12:52:20.264865 13095 raft_consensus.cc:374] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:20.264976 13095 raft_consensus.cc:729] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 728d1642a4804705825b31d2494f6356, State: Initialized, Role: FOLLOWER
I20260924 12:52:20.265813 13095 consensus_queue.cc:260] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } }
I20260924 12:52:20.267486 12936 heartbeater.cc:503] Master 127.11.49.126:39889 was elected leader, sending a full tablet report...
I20260924 12:52:20.269529 13095 ts_tablet_manager.cc:1428] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260924 12:52:20.270579 13096 raft_consensus.cc:348] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } }
I20260924 12:52:20.271224 13096 raft_consensus.cc:374] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:20.271340 13096 raft_consensus.cc:729] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1720101a05324f5fadbb956b60b91dfe, State: Initialized, Role: FOLLOWER
I20260924 12:52:20.272545 13096 consensus_queue.cc:260] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } }
I20260924 12:52:20.273221 13098 raft_consensus.cc:348] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } }
I20260924 12:52:20.273939 13098 raft_consensus.cc:374] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:20.274149 13098 raft_consensus.cc:729] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3237a3d71c0048a8a74e04f0bfaa40e3, State: Initialized, Role: FOLLOWER
I20260924 12:52:20.275329 13098 consensus_queue.cc:260] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } }
I20260924 12:52:20.276015 13076 heartbeater.cc:503] Master 127.11.49.126:39889 was elected leader, sending a full tablet report...
I20260924 12:52:20.276587 13096 ts_tablet_manager.cc:1428] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: Time spent starting tablet: real 0.019s user 0.016s sys 0.002s
I20260924 12:52:20.277201 13098 ts_tablet_manager.cc:1428] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
W20260924 12:52:20.334949 13077 tablet.cc:2369] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:52:20.421644 12937 tablet.cc:2369] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:52:20.511348 12797 tablet.cc:2369] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:52:20.521130 13101 raft_consensus.cc:482] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:52:20.521597 13101 raft_consensus.cc:504] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } }
I20260924 12:52:20.523936 13101 leader_election.cc:288] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1720101a05324f5fadbb956b60b91dfe (127.11.49.67:42893), 3237a3d71c0048a8a74e04f0bfaa40e3 (127.11.49.65:40333)
I20260924 12:52:20.532001 13093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.524652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:46219 (local address 127.11.49.65:40333)
0924 12:52:20.524950 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:20.524960 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:20.525722 (+ 762us) server_negotiation.cc:407] Connection header received
0924 12:52:20.525974 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:20.525985 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:20.526098 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:20.526205 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:20.527273 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.528224 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.530189 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.530981 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.531175 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.531262 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:20.531558 (+ 296us) server_negotiation.cc:299] Negotiation successful
0924 12:52:20.531698 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260924 12:52:20.532155 13104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.524409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40333 (local address 127.11.49.66:46219)
0924 12:52:20.525554 (+ 1145us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:20.525581 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:20.525775 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:20.526562 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:20.526566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:20.526604 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:20.527079 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.527088 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.528392 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.528400 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.530015 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.530030 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.531208 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.531214 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.531382 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.531412 (+ 30us) client_negotiation.cc:769] Sending connection context
0924 12:52:20.531534 (+ 122us) client_negotiation.cc:240] Negotiation successful
0924 12:52:20.531703 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"mutex_wait_us":1,"thread_start_us":592,"threads_started":1}
I20260924 12:52:20.532688 13105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.524486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:42893 (local address 127.11.49.66:55573)
0924 12:52:20.525918 (+ 1432us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:20.525946 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:20.526105 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:20.526457 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:20.526460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:20.526480 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:20.526882 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.526891 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.528078 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.528085 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.529841 (+ 1756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.529856 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.531492 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.531498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.531696 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.531722 (+ 26us) client_negotiation.cc:769] Sending connection context
0924 12:52:20.531866 (+ 144us) client_negotiation.cc:240] Negotiation successful
0924 12:52:20.532038 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1278,"mutex_wait_us":4,"thread_start_us":1011,"threads_started":1}
I20260924 12:52:20.532999 13091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.524432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:55573 (local address 127.11.49.67:42893)
0924 12:52:20.524705 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:20.524711 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:20.526062 (+ 1351us) server_negotiation.cc:407] Connection header received
0924 12:52:20.526241 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:20.526245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:20.526306 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:20.526411 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:20.527131 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.527916 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.530055 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.531175 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.531451 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.531547 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:20.531896 (+ 349us) server_negotiation.cc:299] Negotiation successful
0924 12:52:20.532065 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260924 12:52:20.533341 12749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eac885e3aa19494a8894ec7103c6b3fa" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" is_pre_election: true
I20260924 12:52:20.533993 12749 raft_consensus.cc:2454] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 0.
I20260924 12:52:20.534119 13026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eac885e3aa19494a8894ec7103c6b3fa" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1720101a05324f5fadbb956b60b91dfe" is_pre_election: true
I20260924 12:52:20.534633 13026 raft_consensus.cc:2454] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 0.
I20260924 12:52:20.535015 12817 leader_election.cc:302] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3237a3d71c0048a8a74e04f0bfaa40e3, 728d1642a4804705825b31d2494f6356; no voters:
I20260924 12:52:20.535656 13101 raft_consensus.cc:2781] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:52:20.535831 13101 raft_consensus.cc:482] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:52:20.535951 13101 raft_consensus.cc:3037] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:20.538664 13101 raft_consensus.cc:504] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } }
I20260924 12:52:20.539489 13101 leader_election.cc:288] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 election: Requested vote from peers 1720101a05324f5fadbb956b60b91dfe (127.11.49.67:42893), 3237a3d71c0048a8a74e04f0bfaa40e3 (127.11.49.65:40333)
I20260924 12:52:20.540115 13026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eac885e3aa19494a8894ec7103c6b3fa" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1720101a05324f5fadbb956b60b91dfe"
I20260924 12:52:20.540236 12749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eac885e3aa19494a8894ec7103c6b3fa" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3"
I20260924 12:52:20.540407 13026 raft_consensus.cc:3037] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:20.540463 12749 raft_consensus.cc:3037] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:20.543768 12749 raft_consensus.cc:2454] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 1.
I20260924 12:52:20.543768 13026 raft_consensus.cc:2454] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 1.
I20260924 12:52:20.544453 12817 leader_election.cc:302] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1720101a05324f5fadbb956b60b91dfe, 3237a3d71c0048a8a74e04f0bfaa40e3, 728d1642a4804705825b31d2494f6356; no voters:
I20260924 12:52:20.544970 13101 raft_consensus.cc:2781] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:20.545547 13101 raft_consensus.cc:686] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 1 LEADER]: Becoming Leader. State: Replica: 728d1642a4804705825b31d2494f6356, State: Running, Role: LEADER
I20260924 12:52:20.546195 13101 consensus_queue.cc:237] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } }
I20260924 12:52:20.552814 12588 catalog_manager.cc:5495] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 reported cstate change: term changed from 0 to 1, leader changed from <none> to 728d1642a4804705825b31d2494f6356 (127.11.49.66). New cstate: current_term: 1 leader_uuid: "728d1642a4804705825b31d2494f6356" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } health_report { overall_health: UNKNOWN } } }
I20260924 12:52:20.616685 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.609285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54360 (local address 127.11.49.66:45993)
0924 12:52:20.609542 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:20.609550 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:20.609907 (+ 357us) server_negotiation.cc:407] Connection header received
0924 12:52:20.610249 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:20.610254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:20.610357 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:20.610535 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:52:20.610952 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.611744 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.613373 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.614258 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.614450 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.614987 (+ 537us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:52:20.615731 (+ 744us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:52:20.615864 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:20.616110 (+ 246us) server_negotiation.cc:299] Negotiation successful
0924 12:52:20.616212 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260924 12:52:20.627281 13026 raft_consensus.cc:1261] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe [term 1 FOLLOWER]: Refusing update from remote peer 728d1642a4804705825b31d2494f6356: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:20.627281 12749 raft_consensus.cc:1261] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 1 FOLLOWER]: Refusing update from remote peer 728d1642a4804705825b31d2494f6356: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:20.628859 13106 consensus_queue.cc:1035] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:20.629339 13101 consensus_queue.cc:1035] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:20.643246 13109 mvcc.cc:205] Tried to move back new op lower bound from 7332881779195465728 to 7332881778883358720. Current Snapshot: MvccSnapshot[applied={T|T < 7332881779195465728}]
I20260924 12:52:20.668896 12589 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:20.669200 12589 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:20.673751 12589 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e: Sending DeleteTablet for 3 replicas of tablet eac885e3aa19494a8894ec7103c6b3fa
I20260924 12:52:20.675117 12726 tablet_service.cc:1514] Processing DeleteTablet for tablet eac885e3aa19494a8894ec7103c6b3fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:20 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:43228
I20260924 12:52:20.675216 13006 tablet_service.cc:1514] Processing DeleteTablet for tablet eac885e3aa19494a8894ec7103c6b3fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:20 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:44962
I20260924 12:52:20.675980 12866 tablet_service.cc:1514] Processing DeleteTablet for tablet eac885e3aa19494a8894ec7103c6b3fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:20 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:54356
I20260924 12:52:20.677335 13120 tablet_replica.cc:330] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: stopping tablet replica
I20260924 12:52:20.678056 13120 raft_consensus.cc:2229] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:52:20.679013 13120 raft_consensus.cc:2258] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:20.679102 12588 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:52:20.680058 12588 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:52:20.680421 13119 tablet_replica.cc:330] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: stopping tablet replica
I20260924 12:52:20.681017 13119 raft_consensus.cc:2229] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:20.681667 13119 raft_consensus.cc:2258] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:20.682644 13118 tablet_replica.cc:330] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: stopping tablet replica
I20260924 12:52:20.683365 13118 raft_consensus.cc:2229] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:20.683735 13120 ts_tablet_manager.cc:1905] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:20.683985 13118 raft_consensus.cc:2258] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:20.687117 13119 ts_tablet_manager.cc:1905] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:20.689494 12866 tablet_service.cc:1467] Processing CreateTablet for tablet ca40d7dcbfad455f920c5200867d5b3b (DEFAULT_TABLE table=test-table [id=bf72bc18fb8c4ae9ad790e487fa2262d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:20.690014 12866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca40d7dcbfad455f920c5200867d5b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:20.693115 13120 ts_tablet_manager.cc:1918] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:52:20.693286 13120 log.cc:1196] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/eac885e3aa19494a8894ec7103c6b3fa
I20260924 12:52:20.693909 13120 ts_tablet_manager.cc:1939] T eac885e3aa19494a8894ec7103c6b3fa P 728d1642a4804705825b31d2494f6356: Deleting consensus metadata
I20260924 12:52:20.695873 13119 ts_tablet_manager.cc:1918] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:52:20.696121 13119 log.cc:1196] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/eac885e3aa19494a8894ec7103c6b3fa
I20260924 12:52:20.696033 12573 catalog_manager.cc:4841] TS 728d1642a4804705825b31d2494f6356 (127.11.49.66:45993): tablet eac885e3aa19494a8894ec7103c6b3fa (table test-table [id=3f2e65168a3747fdbf84a062f92859f1]) successfully deleted
I20260924 12:52:20.697623 13006 tablet_service.cc:1467] Processing CreateTablet for tablet ca40d7dcbfad455f920c5200867d5b3b (DEFAULT_TABLE table=test-table [id=bf72bc18fb8c4ae9ad790e487fa2262d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:20.697770 12726 tablet_service.cc:1467] Processing CreateTablet for tablet ca40d7dcbfad455f920c5200867d5b3b (DEFAULT_TABLE table=test-table [id=bf72bc18fb8c4ae9ad790e487fa2262d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:20.698262 13006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca40d7dcbfad455f920c5200867d5b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:20.698318 13118 ts_tablet_manager.cc:1905] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:20.698534 12726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca40d7dcbfad455f920c5200867d5b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:20.698529 13095 tablet_bootstrap.cc:492] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356: Bootstrap starting.
I20260924 12:52:20.700304 13095 tablet_bootstrap.cc:654] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:20.706400 13118 ts_tablet_manager.cc:1918] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:52:20.706733 13096 tablet_bootstrap.cc:492] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe: Bootstrap starting.
I20260924 12:52:20.707314 13119 ts_tablet_manager.cc:1939] T eac885e3aa19494a8894ec7103c6b3fa P 3237a3d71c0048a8a74e04f0bfaa40e3: Deleting consensus metadata
I20260924 12:52:20.709020 13096 tablet_bootstrap.cc:654] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:20.709545 13095 tablet_bootstrap.cc:492] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356: No bootstrap required, opened a new log
I20260924 12:52:20.709709 13095 ts_tablet_manager.cc:1397] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260924 12:52:20.710620 13095 raft_consensus.cc:348] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.710865 13095 raft_consensus.cc:374] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:20.710981 13095 raft_consensus.cc:729] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 728d1642a4804705825b31d2494f6356, State: Initialized, Role: FOLLOWER
I20260924 12:52:20.711277 13095 consensus_queue.cc:260] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.706717 13118 log.cc:1196] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/eac885e3aa19494a8894ec7103c6b3fa
I20260924 12:52:20.714818 12574 catalog_manager.cc:4841] TS 3237a3d71c0048a8a74e04f0bfaa40e3 (127.11.49.65:40333): tablet eac885e3aa19494a8894ec7103c6b3fa (table test-table [id=3f2e65168a3747fdbf84a062f92859f1]) successfully deleted
I20260924 12:52:20.715374 13118 ts_tablet_manager.cc:1939] T eac885e3aa19494a8894ec7103c6b3fa P 1720101a05324f5fadbb956b60b91dfe: Deleting consensus metadata
I20260924 12:52:20.715878 13095 ts_tablet_manager.cc:1428] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260924 12:52:20.718283 12576 catalog_manager.cc:4841] TS 1720101a05324f5fadbb956b60b91dfe (127.11.49.67:42893): tablet eac885e3aa19494a8894ec7103c6b3fa (table test-table [id=3f2e65168a3747fdbf84a062f92859f1]) successfully deleted
I20260924 12:52:20.718926 13098 tablet_bootstrap.cc:492] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3: Bootstrap starting.
I20260924 12:52:20.721112 13098 tablet_bootstrap.cc:654] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:20.722615 13096 tablet_bootstrap.cc:492] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe: No bootstrap required, opened a new log
I20260924 12:52:20.722815 13096 ts_tablet_manager.cc:1397] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.001s
I20260924 12:52:20.723845 13098 tablet_bootstrap.cc:492] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3: No bootstrap required, opened a new log
I20260924 12:52:20.724018 13098 ts_tablet_manager.cc:1397] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260924 12:52:20.723870 13096 raft_consensus.cc:348] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.724186 13096 raft_consensus.cc:374] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:20.724320 13096 raft_consensus.cc:729] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1720101a05324f5fadbb956b60b91dfe, State: Initialized, Role: FOLLOWER
I20260924 12:52:20.724622 13096 consensus_queue.cc:260] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.724941 13098 raft_consensus.cc:348] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.725147 13098 raft_consensus.cc:374] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:20.725236 13098 raft_consensus.cc:729] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3237a3d71c0048a8a74e04f0bfaa40e3, State: Initialized, Role: FOLLOWER
I20260924 12:52:20.725538 13098 consensus_queue.cc:260] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.726221 13098 ts_tablet_manager.cc:1428] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 12:52:20.728826 13096 ts_tablet_manager.cc:1428] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260924 12:52:20.749725 13101 raft_consensus.cc:482] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:52:20.750023 13101 raft_consensus.cc:504] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.750953 13101 leader_election.cc:288] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3237a3d71c0048a8a74e04f0bfaa40e3 (127.11.49.65:40333), 1720101a05324f5fadbb956b60b91dfe (127.11.49.67:42893)
I20260924 12:52:20.751601 12749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca40d7dcbfad455f920c5200867d5b3b" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" is_pre_election: true
I20260924 12:52:20.751741 13026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca40d7dcbfad455f920c5200867d5b3b" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1720101a05324f5fadbb956b60b91dfe" is_pre_election: true
I20260924 12:52:20.751959 12749 raft_consensus.cc:2454] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 0.
I20260924 12:52:20.751986 13026 raft_consensus.cc:2454] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 0.
I20260924 12:52:20.752537 12817 leader_election.cc:302] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3237a3d71c0048a8a74e04f0bfaa40e3, 728d1642a4804705825b31d2494f6356; no voters:
I20260924 12:52:20.752944 13101 raft_consensus.cc:2781] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:52:20.753116 13101 raft_consensus.cc:482] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:52:20.753223 13101 raft_consensus.cc:3037] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:20.757069 13101 raft_consensus.cc:504] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.758719 12749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca40d7dcbfad455f920c5200867d5b3b" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3"
I20260924 12:52:20.758960 12749 raft_consensus.cc:3037] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:20.759071 13026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca40d7dcbfad455f920c5200867d5b3b" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1720101a05324f5fadbb956b60b91dfe"
I20260924 12:52:20.759425 13026 raft_consensus.cc:3037] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:20.762269 12749 raft_consensus.cc:2454] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 1.
I20260924 12:52:20.762907 12817 leader_election.cc:302] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3237a3d71c0048a8a74e04f0bfaa40e3, 728d1642a4804705825b31d2494f6356; no voters:
I20260924 12:52:20.763020 13026 raft_consensus.cc:2454] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 1.
I20260924 12:52:20.763305 13106 raft_consensus.cc:2781] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:20.763749 13101 leader_election.cc:288] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 election: Requested vote from peers 3237a3d71c0048a8a74e04f0bfaa40e3 (127.11.49.65:40333), 1720101a05324f5fadbb956b60b91dfe (127.11.49.67:42893)
I20260924 12:52:20.765457 13106 raft_consensus.cc:686] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 1 LEADER]: Becoming Leader. State: Replica: 728d1642a4804705825b31d2494f6356, State: Running, Role: LEADER
I20260924 12:52:20.765882 13106 consensus_queue.cc:237] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.769670 12588 catalog_manager.cc:5495] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 reported cstate change: term changed from 0 to 1, leader changed from <none> to 728d1642a4804705825b31d2494f6356 (127.11.49.66). New cstate: current_term: 1 leader_uuid: "728d1642a4804705825b31d2494f6356" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } health_report { overall_health: UNKNOWN } } }
Sep 24 12:52:20 dist-test-slave-m9hg krb5kdc[12544](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254337, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:20.825660 13131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.802902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39889 (local address 127.0.0.1:40732)
0924 12:52:20.803690 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:20.803721 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:20.803904 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:20.804353 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:20.804362 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:20.805016 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:20.805227 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.805236 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.806352 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.806358 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.807413 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.807424 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.808177 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.808183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.808396 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.815790 (+ 7394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:20.815812 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:20.818787 (+ 2975us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:20.822538 (+ 3751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:20.822561 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:20.822570 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:20.823039 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:20.823523 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:20.823531 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:20.823535 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:20.823695 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:20.824306 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:20.824316 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:20.824575 (+ 259us) client_negotiation.cc:769] Sending connection context
0924 12:52:20.824791 (+ 216us) client_negotiation.cc:240] Negotiation successful
0924 12:52:20.825126 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":423,"threads_started":1}
I20260924 12:52:20.825687 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.802988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40732 (local address 127.11.49.126:39889)
0924 12:52:20.804013 (+ 1025us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:20.804020 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:20.804047 (+ 27us) server_negotiation.cc:407] Connection header received
0924 12:52:20.804105 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:20.804108 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:20.804160 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:20.804279 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:20.805388 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.806209 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.807571 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.808000 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.808143 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.819049 (+ 10906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:20.819055 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:20.819059 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:20.819089 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:20.822334 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:20.823188 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:20.823194 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:20.823198 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:20.823408 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:20.823810 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:20.823817 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:20.823823 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:20.824137 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:20.824363 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:20.824888 (+ 525us) server_negotiation.cc:299] Negotiation successful
0924 12:52:20.825278 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":171,"server-negotiator.queue_time_us":883,"thread_start_us":711,"threads_started":1}
I20260924 12:52:20.831637 12588 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:40732:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260924 12:52:20.832886 12588 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:52:20.841656 13006 tablet_service.cc:1467] Processing CreateTablet for tablet 4b4c3e447192449e8289bd6768062adb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4a9d616920c84138954b9b963a1e0f94]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 12:52:20.841634 12726 tablet_service.cc:1467] Processing CreateTablet for tablet 4b4c3e447192449e8289bd6768062adb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4a9d616920c84138954b9b963a1e0f94]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 12:52:20.842312 13006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b4c3e447192449e8289bd6768062adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:20.842408 12726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b4c3e447192449e8289bd6768062adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:20.844672 12866 tablet_service.cc:1467] Processing CreateTablet for tablet 4b4c3e447192449e8289bd6768062adb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4a9d616920c84138954b9b963a1e0f94]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 12:52:20.845448 12866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b4c3e447192449e8289bd6768062adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:20.849135 13096 tablet_bootstrap.cc:492] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe: Bootstrap starting.
I20260924 12:52:20.850678 13096 tablet_bootstrap.cc:654] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:20.854986 13095 tablet_bootstrap.cc:492] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: Bootstrap starting.
I20260924 12:52:20.856942 13095 tablet_bootstrap.cc:654] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:20.858157 13098 tablet_bootstrap.cc:492] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3: Bootstrap starting.
I20260924 12:52:20.858271 13096 tablet_bootstrap.cc:492] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe: No bootstrap required, opened a new log
I20260924 12:52:20.858421 13096 ts_tablet_manager.cc:1397] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.001s
I20260924 12:52:20.859215 13096 raft_consensus.cc:348] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.859475 13096 raft_consensus.cc:374] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:20.859560 13096 raft_consensus.cc:729] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1720101a05324f5fadbb956b60b91dfe, State: Initialized, Role: FOLLOWER
I20260924 12:52:20.859929 13098 tablet_bootstrap.cc:654] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:20.859840 13096 consensus_queue.cc:260] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.860448 13096 ts_tablet_manager.cc:1428] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260924 12:52:20.861013 13102 tablet_replica.cc:439] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } }
I20260924 12:52:20.861399 13102 tablet_replica.cc:442] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:20.863018 13098 tablet_bootstrap.cc:492] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3: No bootstrap required, opened a new log
I20260924 12:52:20.863190 13098 ts_tablet_manager.cc:1397] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260924 12:52:20.863524 13095 tablet_bootstrap.cc:492] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: No bootstrap required, opened a new log
I20260924 12:52:20.863715 13095 ts_tablet_manager.cc:1397] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260924 12:52:20.864012 13098 raft_consensus.cc:348] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.864244 13098 raft_consensus.cc:374] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:20.864362 13098 raft_consensus.cc:729] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3237a3d71c0048a8a74e04f0bfaa40e3, State: Initialized, Role: FOLLOWER
I20260924 12:52:20.864581 13095 raft_consensus.cc:348] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.864604 13098 consensus_queue.cc:260] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.864845 13095 raft_consensus.cc:374] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:20.864934 13095 raft_consensus.cc:729] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 728d1642a4804705825b31d2494f6356, State: Initialized, Role: FOLLOWER
I20260924 12:52:20.865047 13103 tablet_replica.cc:439] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } }
I20260924 12:52:20.865226 13095 consensus_queue.cc:260] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.865446 13103 tablet_replica.cc:442] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:20.865703 13106 tablet_replica.cc:439] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } }
I20260924 12:52:20.865998 13106 tablet_replica.cc:442] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:20.866540 13095 ts_tablet_manager.cc:1428] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 12:52:20.867013 13098 ts_tablet_manager.cc:1428] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260924 12:52:20.921824 13106 raft_consensus.cc:482] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:52:20.922150 13106 raft_consensus.cc:504] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.923029 13106 leader_election.cc:288] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3237a3d71c0048a8a74e04f0bfaa40e3 (127.11.49.65:40333), 1720101a05324f5fadbb956b60b91dfe (127.11.49.67:42893)
I20260924 12:52:20.923822 13026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4c3e447192449e8289bd6768062adb" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1720101a05324f5fadbb956b60b91dfe" is_pre_election: true
I20260924 12:52:20.924007 12749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4c3e447192449e8289bd6768062adb" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" is_pre_election: true
I20260924 12:52:20.924157 13026 raft_consensus.cc:2454] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 0.
I20260924 12:52:20.924333 12749 raft_consensus.cc:2454] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 0.
I20260924 12:52:20.924971 12819 leader_election.cc:302] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1720101a05324f5fadbb956b60b91dfe, 728d1642a4804705825b31d2494f6356; no voters:
I20260924 12:52:20.925457 13106 raft_consensus.cc:2781] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:52:20.925618 13106 raft_consensus.cc:482] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:52:20.925734 13106 raft_consensus.cc:3037] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:20.928604 13106 raft_consensus.cc:504] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.929463 13106 leader_election.cc:288] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 election: Requested vote from peers 3237a3d71c0048a8a74e04f0bfaa40e3 (127.11.49.65:40333), 1720101a05324f5fadbb956b60b91dfe (127.11.49.67:42893)
I20260924 12:52:20.930105 13026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4c3e447192449e8289bd6768062adb" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1720101a05324f5fadbb956b60b91dfe"
I20260924 12:52:20.930244 12749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4c3e447192449e8289bd6768062adb" candidate_uuid: "728d1642a4804705825b31d2494f6356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3"
I20260924 12:52:20.930399 13026 raft_consensus.cc:3037] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:20.930498 12749 raft_consensus.cc:3037] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:20.933883 13026 raft_consensus.cc:2454] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 1.
I20260924 12:52:20.933926 12749 raft_consensus.cc:2454] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 728d1642a4804705825b31d2494f6356 in term 1.
I20260924 12:52:20.934532 12819 leader_election.cc:302] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1720101a05324f5fadbb956b60b91dfe, 728d1642a4804705825b31d2494f6356; no voters:
I20260924 12:52:20.934917 13106 raft_consensus.cc:2781] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:20.935348 13106 raft_consensus.cc:686] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [term 1 LEADER]: Becoming Leader. State: Replica: 728d1642a4804705825b31d2494f6356, State: Running, Role: LEADER
I20260924 12:52:20.935745 13106 consensus_queue.cc:237] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } }
I20260924 12:52:20.937968 13124 tablet_replica.cc:439] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: TxnStatusTablet state changed. Reason: New leader 728d1642a4804705825b31d2494f6356. Latest consensus state: current_term: 1 leader_uuid: "728d1642a4804705825b31d2494f6356" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } }
I20260924 12:52:20.938545 13124 tablet_replica.cc:442] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: This TxnStatusTablet replica's current role is: LEADER
I20260924 12:52:20.939514 13137 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260924 12:52:20.939810 13137 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260924 12:52:20.940376 12588 catalog_manager.cc:5495] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 reported cstate change: term changed from 0 to 1, leader changed from <none> to 728d1642a4804705825b31d2494f6356 (127.11.49.66). New cstate: current_term: 1 leader_uuid: "728d1642a4804705825b31d2494f6356" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } health_report { overall_health: UNKNOWN } } }
I20260924 12:52:20.969564 13131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.963066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:45993 (local address 127.0.0.1:54376)
0924 12:52:20.963340 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:20.963364 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:20.963526 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:20.964117 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:20.964121 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:20.964134 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 12:52:20.964386 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.964396 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.965976 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.965980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.967080 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:20.967093 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.968236 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.968241 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:20.968483 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.968554 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 12:52:20.969086 (+ 532us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 12:52:20.969103 (+ 17us) client_negotiation.cc:769] Sending connection context
0924 12:52:20.969185 (+ 82us) client_negotiation.cc:240] Negotiation successful
0924 12:52:20.969312 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260924 12:52:20.969745 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:20.963268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54376 (local address 127.11.49.66:45993)
0924 12:52:20.963533 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:20.963541 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:20.963570 (+ 29us) server_negotiation.cc:407] Connection header received
0924 12:52:20.963750 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:20.963756 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:20.963881 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:20.964053 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:52:20.964554 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.965795 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.967261 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:20.968013 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:20.968206 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:20.968769 (+ 563us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:52:20.968963 (+ 194us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:52:20.969074 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:20.969237 (+ 163us) server_negotiation.cc:299] Negotiation successful
0924 12:52:20.969348 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260924 12:52:20.974961 13026 raft_consensus.cc:1261] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe [term 1 FOLLOWER]: Refusing update from remote peer 728d1642a4804705825b31d2494f6356: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:20.975023 12749 raft_consensus.cc:1261] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 1 FOLLOWER]: Refusing update from remote peer 728d1642a4804705825b31d2494f6356: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:20.975875 13124 consensus_queue.cc:1035] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:20.976478 13106 consensus_queue.cc:1035] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:20.981067 13103 tablet_replica.cc:439] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3: TxnStatusTablet state changed. Reason: New leader 728d1642a4804705825b31d2494f6356. Latest consensus state: current_term: 1 leader_uuid: "728d1642a4804705825b31d2494f6356" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } }
I20260924 12:52:20.981541 13103 tablet_replica.cc:442] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:20.983606 13102 tablet_replica.cc:439] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe: TxnStatusTablet state changed. Reason: New leader 728d1642a4804705825b31d2494f6356. Latest consensus state: current_term: 1 leader_uuid: "728d1642a4804705825b31d2494f6356" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } }
I20260924 12:52:20.983901 13102 tablet_replica.cc:442] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:20.985771 13101 tablet_replica.cc:439] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "728d1642a4804705825b31d2494f6356" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } }
I20260924 12:52:20.986085 13101 tablet_replica.cc:442] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: This TxnStatusTablet replica's current role is: LEADER
I20260924 12:52:20.987087 13101 tablet_replica.cc:439] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "728d1642a4804705825b31d2494f6356" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } }
I20260924 12:52:20.987351 13101 tablet_replica.cc:442] T 4b4c3e447192449e8289bd6768062adb P 728d1642a4804705825b31d2494f6356: This TxnStatusTablet replica's current role is: LEADER
I20260924 12:52:20.988696 13102 tablet_replica.cc:439] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "728d1642a4804705825b31d2494f6356" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } }
I20260924 12:52:20.988929 13102 tablet_replica.cc:442] T 4b4c3e447192449e8289bd6768062adb P 1720101a05324f5fadbb956b60b91dfe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:20.990034 13111 mvcc.cc:205] Tried to move back new op lower bound from 7332881780625100800 to 7332881780475486208. Current Snapshot: MvccSnapshot[applied={T|T < 7332881780625100800}]
I20260924 12:52:20.990485 13103 tablet_replica.cc:439] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "728d1642a4804705825b31d2494f6356" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 } } peers { permanent_uuid: "728d1642a4804705825b31d2494f6356" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45993 } } peers { permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 } } }
I20260924 12:52:20.990753 13103 tablet_replica.cc:442] T 4b4c3e447192449e8289bd6768062adb P 3237a3d71c0048a8a74e04f0bfaa40e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:21.019856 13143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:21.011579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:45993 (local address 127.11.49.66:40371)
0924 12:52:21.012508 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:21.012526 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:21.012673 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:21.013194 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:21.013199 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:21.013215 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 12:52:21.013696 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:21.013709 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.015361 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.015365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:21.016833 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:21.016849 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.018083 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.018089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:21.018283 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:21.018386 (+ 103us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 12:52:21.019138 (+ 752us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 12:52:21.019148 (+ 10us) client_negotiation.cc:769] Sending connection context
0924 12:52:21.019243 (+ 95us) client_negotiation.cc:240] Negotiation successful
0924 12:52:21.019392 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747,"thread_start_us":523,"threads_started":1}
I20260924 12:52:21.019891 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:21.011512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:40371 (local address 127.11.49.66:45993)
0924 12:52:21.011867 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:21.011877 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:21.012637 (+ 760us) server_negotiation.cc:407] Connection header received
0924 12:52:21.012837 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:21.012843 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:21.012959 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:21.013120 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:52:21.013929 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.015141 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.017042 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.017775 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.017952 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:21.018647 (+ 695us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:52:21.018837 (+ 190us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:52:21.019134 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:21.019299 (+ 165us) server_negotiation.cc:299] Negotiation successful
0924 12:52:21.019433 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260924 12:52:21.032572 13026 raft_consensus.cc:1261] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe [term 1 FOLLOWER]: Refusing update from remote peer 728d1642a4804705825b31d2494f6356: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:21.033511 12749 raft_consensus.cc:1261] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 1 FOLLOWER]: Refusing update from remote peer 728d1642a4804705825b31d2494f6356: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:21.034240 13124 consensus_queue.cc:1035] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3237a3d71c0048a8a74e04f0bfaa40e3" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:21.034500 13101 consensus_queue.cc:1035] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1720101a05324f5fadbb956b60b91dfe" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:21.128641 12587 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:21.128918 12587 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:21.133409 12587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0fed5b513594425fbd5aed0e2ae65f3e: Sending DeleteTablet for 3 replicas of tablet ca40d7dcbfad455f920c5200867d5b3b
I20260924 12:52:21.134841 12726 tablet_service.cc:1514] Processing DeleteTablet for tablet ca40d7dcbfad455f920c5200867d5b3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:21 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:43228
I20260924 12:52:21.134928 12865 tablet_service.cc:1514] Processing DeleteTablet for tablet ca40d7dcbfad455f920c5200867d5b3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:21 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:54356
I20260924 12:52:21.135155 13006 tablet_service.cc:1514] Processing DeleteTablet for tablet ca40d7dcbfad455f920c5200867d5b3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:21 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:44962
I20260924 12:52:21.135473 13119 tablet_replica.cc:330] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3: stopping tablet replica
I20260924 12:52:21.135705 13118 tablet_replica.cc:330] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe: stopping tablet replica
I20260924 12:52:21.135803 13119 raft_consensus.cc:2229] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:21.135912 13118 raft_consensus.cc:2229] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:21.136031 13119 raft_consensus.cc:2258] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:21.136129 13118 raft_consensus.cc:2258] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:21.136480 13120 tablet_replica.cc:330] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356: stopping tablet replica
I20260924 12:52:21.136722 13120 raft_consensus.cc:2229] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:52:21.137102 13120 raft_consensus.cc:2258] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:21.137343 13119 ts_tablet_manager.cc:1905] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:21.137957 13118 ts_tablet_manager.cc:1905] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:21.138599 13120 ts_tablet_manager.cc:1905] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:21.144833 13119 ts_tablet_manager.cc:1918] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:52:21.145020 13119 log.cc:1196] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/ca40d7dcbfad455f920c5200867d5b3b
I20260924 12:52:21.145471 13119 ts_tablet_manager.cc:1939] T ca40d7dcbfad455f920c5200867d5b3b P 3237a3d71c0048a8a74e04f0bfaa40e3: Deleting consensus metadata
I20260924 12:52:21.146649 12574 catalog_manager.cc:4841] TS 3237a3d71c0048a8a74e04f0bfaa40e3 (127.11.49.65:40333): tablet ca40d7dcbfad455f920c5200867d5b3b (table test-table [id=bf72bc18fb8c4ae9ad790e487fa2262d]) successfully deleted
I20260924 12:52:21.146754 13120 ts_tablet_manager.cc:1918] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:52:21.146915 13120 log.cc:1196] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/ca40d7dcbfad455f920c5200867d5b3b
I20260924 12:52:21.147387 13120 ts_tablet_manager.cc:1939] T ca40d7dcbfad455f920c5200867d5b3b P 728d1642a4804705825b31d2494f6356: Deleting consensus metadata
I20260924 12:52:21.148504 12573 catalog_manager.cc:4841] TS 728d1642a4804705825b31d2494f6356 (127.11.49.66:45993): tablet ca40d7dcbfad455f920c5200867d5b3b (table test-table [id=bf72bc18fb8c4ae9ad790e487fa2262d]) successfully deleted
I20260924 12:52:21.150136 13118 ts_tablet_manager.cc:1918] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:52:21.150420 13118 log.cc:1196] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/ca40d7dcbfad455f920c5200867d5b3b
I20260924 12:52:21.150931 13118 ts_tablet_manager.cc:1939] T ca40d7dcbfad455f920c5200867d5b3b P 1720101a05324f5fadbb956b60b91dfe: Deleting consensus metadata
I20260924 12:52:21.152652 12576 catalog_manager.cc:4841] TS 1720101a05324f5fadbb956b60b91dfe (127.11.49.67:42893): tablet ca40d7dcbfad455f920c5200867d5b3b (table test-table [id=bf72bc18fb8c4ae9ad790e487fa2262d]) successfully deleted
Sep 24 12:52:21 dist-test-slave-m9hg krb5kdc[12544](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254340, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:52:21.173640 13148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:21.155205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43242 (local address 127.11.49.65:40333)
0924 12:52:21.155816 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:21.155824 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:21.156138 (+ 314us) server_negotiation.cc:407] Connection header received
0924 12:52:21.156403 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:21.156407 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:21.156480 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:21.156603 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:21.158038 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.158778 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.160053 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.160588 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.160737 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:21.166181 (+ 5444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:21.166198 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:21.166215 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:21.166255 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:21.169638 (+ 3383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:21.171014 (+ 1376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:21.171022 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:21.171025 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:21.171221 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:21.171792 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:21.171796 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:21.171798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:21.172256 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:21.172677 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:21.173101 (+ 424us) server_negotiation.cc:299] Negotiation successful
0924 12:52:21.173286 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":266,"threads_started":1}
W20260924 12:52:21.175081 12791 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43242
I20260924 12:52:21.196765 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:21.179344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40746 (local address 127.11.49.126:39889)
0924 12:52:21.179685 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:21.179693 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:21.179725 (+ 32us) server_negotiation.cc:407] Connection header received
0924 12:52:21.179840 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:21.179847 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:21.179955 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:21.180108 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:21.181562 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.182908 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.184707 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.185488 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.185700 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:21.188223 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:21.188232 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:21.188241 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:21.188390 (+ 149us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:21.192818 (+ 4428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:21.193703 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:21.193711 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:21.193715 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:21.193998 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:21.194487 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:21.194493 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:21.194496 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:21.195014 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:21.195400 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:21.195844 (+ 444us) server_negotiation.cc:299] Negotiation successful
0924 12:52:21.196195 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179}
W20260924 12:52:21.197763 12587 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40746
I20260924 12:52:21.200467 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 12660
I20260924 12:52:21.216583 13148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:21.202325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43248 (local address 127.11.49.65:40333)
0924 12:52:21.202543 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:21.202548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:21.202563 (+ 15us) server_negotiation.cc:407] Connection header received
0924 12:52:21.202622 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:21.202626 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:21.202684 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:21.202816 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:21.204078 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.204897 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.206062 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.206567 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.206716 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:21.210280 (+ 3564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:21.210285 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:21.210289 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:21.210351 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:21.213361 (+ 3010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:21.214459 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:21.214463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:21.214466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:21.214635 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:21.215108 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:21.215112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:21.215114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:21.215398 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:21.215595 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:21.216060 (+ 465us) server_negotiation.cc:299] Negotiation successful
0924 12:52:21.216234 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260924 12:52:21.217435 12791 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43248
W20260924 12:52:21.218199 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 12660: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:52:21.218469 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 12660
I20260924 12:52:21.237310 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 12800
Sep 24 12:52:21 dist-test-slave-m9hg krb5kdc[12544](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254340, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:52:21.255203 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:21.238170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54390 (local address 127.11.49.66:45993)
0924 12:52:21.238397 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:21.238404 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:21.238523 (+ 119us) server_negotiation.cc:407] Connection header received
0924 12:52:21.238842 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:21.238846 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:21.238916 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:21.239052 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:21.240214 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.241142 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.242401 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.242939 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.243109 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:21.248141 (+ 5032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:21.248158 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:21.248177 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:21.248217 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:21.251958 (+ 3741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:21.252852 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:21.252869 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:21.252872 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:21.253009 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:21.253436 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:21.253442 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:21.253445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:21.253855 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:21.254211 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:21.254519 (+ 308us) server_negotiation.cc:299] Negotiation successful
0924 12:52:21.254776 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260924 12:52:21.255954 12931 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54390
W20260924 12:52:21.256965 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 12800: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:52:21.257184 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 12800
I20260924 12:52:21.279772 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 12940
Sep 24 12:52:21 dist-test-slave-m9hg krb5kdc[12544](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254340, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:52:21.298487 13153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:21.280886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44970 (local address 127.11.49.67:42893)
0924 12:52:21.281429 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:21.281434 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:21.281453 (+ 19us) server_negotiation.cc:407] Connection header received
0924 12:52:21.281513 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:21.281517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:21.281583 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:21.281715 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:21.283308 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.284483 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.285896 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:21.286298 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:21.286415 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:21.291441 (+ 5026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:21.291456 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:21.291470 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:21.291508 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:21.294701 (+ 3193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:21.295709 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:21.295716 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:21.295719 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:21.295918 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:21.296454 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:21.296458 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:21.296460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:21.296881 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:21.297203 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:21.297675 (+ 472us) server_negotiation.cc:299] Negotiation successful
0924 12:52:21.297972 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":311,"threads_started":1}
W20260924 12:52:21.299437 13069 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44970
W20260924 12:52:21.300385 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 12940: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:52:21.300589 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 12940
I20260924 12:52:21.319715 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 12557
I20260924 12:52:21.321079 12629 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:21.457238 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 12557
2026-09-24T12:52:21Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5251 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:52:21 dist-test-slave-m9hg krb5kdc[13157](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:52:21 dist-test-slave-m9hg krb5kdc[13157](info): set up 2 sockets
Sep 24 12:52:21 dist-test-slave-m9hg krb5kdc[13157](info): commencing operation
krb5kdc: starting...
W20260924 12:52:22.573163 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:52:22 dist-test-slave-m9hg krb5kdc[13157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:52:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:52:22.800940 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42701
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:42701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:23.210932 13170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:23.211377 13170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:23.211573 13170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:23.219874 13170 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:23.220127 13170 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260924 12:52:23.220207 13170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:23.220363 13170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:23.220428 13170 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:23.220494 13170 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:52:23.232539 13170 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:42701
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:23.234334 13170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:23.236166 13170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:23.251482 13176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:23.251574 13175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:23.251628 13178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:23.252622 13170 server_base.cc:1034] running on GCE node
I20260924 12:52:23.253584 13170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:23.255297 13170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:23.256572 13170 hybrid_clock.cc:648] HybridClock initialized: now 1790254343256507 us; error 59 us; skew 500 ppm
I20260924 12:52:23.257016 13170 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:23 dist-test-slave-m9hg krb5kdc[13157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254343, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:23.260697 13170 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:52:23.262621 13170 webserver.cc:460] Webserver started at http://127.11.49.126:45571/ using document root <none> and password file <none>
I20260924 12:52:23.263450 13170 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:23.263590 13170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:23.263929 13170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:23.267156 13170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "fa3bb06de91d4ce98848bc3015c748d5"
format_stamp: "Formatted at 2026-09-24 12:52:23 on dist-test-slave-m9hg"
server_key: "7d684ba6f298f6b02eed4b9451a7a394"
server_key_iv: "42db84ff567842d93dc37053a021f0a3"
server_key_version: "encryptionkey@0"
I20260924 12:52:23.267987 13170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "fa3bb06de91d4ce98848bc3015c748d5"
format_stamp: "Formatted at 2026-09-24 12:52:23 on dist-test-slave-m9hg"
server_key: "7d684ba6f298f6b02eed4b9451a7a394"
server_key_iv: "42db84ff567842d93dc37053a021f0a3"
server_key_version: "encryptionkey@0"
I20260924 12:52:23.274230 13170 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260924 12:52:23.278692 13185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:23.280566 13170 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:52:23.280797 13170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "fa3bb06de91d4ce98848bc3015c748d5"
format_stamp: "Formatted at 2026-09-24 12:52:23 on dist-test-slave-m9hg"
server_key: "7d684ba6f298f6b02eed4b9451a7a394"
server_key_iv: "42db84ff567842d93dc37053a021f0a3"
server_key_version: "encryptionkey@0"
I20260924 12:52:23.281049 13170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:23.296864 13170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:23.302137 13170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:23.302449 13170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:23.330900 13170 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:42701
I20260924 12:52:23.330919 13246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:42701 every 8 connection(s)
I20260924 12:52:23.332883 13170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:23.337639 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 13170
I20260924 12:52:23.337924 13247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:23.337970 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:23.338932 11461 external_mini_cluster.cc:1428] Setting key 5742618cd8b2dc9a04c761be7b8d89be
I20260924 12:52:23.354259 13247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5: Bootstrap starting.
I20260924 12:52:23.357690 13247 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5: Neither blocks nor log segments found. Creating new log.
Sep 24 12:52:23 dist-test-slave-m9hg krb5kdc[13157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:23.359076 13247 log.cc:824] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:23.362906 13247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5: No bootstrap required, opened a new log
I20260924 12:52:23.370087 13250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:23.341652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46094 (local address 127.11.49.126:42701)
0924 12:52:23.342967 (+ 1315us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:23.342991 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:23.343432 (+ 441us) server_negotiation.cc:407] Connection header received
0924 12:52:23.346127 (+ 2695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:23.346171 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:23.346898 (+ 727us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:23.347528 (+ 630us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:23.349457 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:23.351320 (+ 1863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:23.352963 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:23.353834 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:23.354091 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:23.359746 (+ 5655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:23.359765 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:23.359800 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:23.359890 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:23.364213 (+ 4323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:23.365423 (+ 1210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:23.365442 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:23.365451 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:23.365752 (+ 301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:23.366225 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:23.366228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:23.366230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:23.366973 (+ 743us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:23.367291 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:23.367882 (+ 591us) server_negotiation.cc:299] Negotiation successful
0924 12:52:23.368589 (+ 707us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":993,"thread_start_us":635,"threads_started":1}
I20260924 12:52:23.372725 13247 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3bb06de91d4ce98848bc3015c748d5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42701 } }
I20260924 12:52:23.373346 13247 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:23.373488 13247 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa3bb06de91d4ce98848bc3015c748d5, State: Initialized, Role: FOLLOWER
I20260924 12:52:23.374181 13247 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3bb06de91d4ce98848bc3015c748d5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42701 } }
I20260924 12:52:23.374472 13247 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:23.374585 13247 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:23.374709 13247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:23.377046 13247 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3bb06de91d4ce98848bc3015c748d5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42701 } }
I20260924 12:52:23.377509 13247 leader_election.cc:302] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa3bb06de91d4ce98848bc3015c748d5; no voters:
I20260924 12:52:23.378276 13247 leader_election.cc:288] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:23.378556 13252 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:23.379719 13252 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [term 1 LEADER]: Becoming Leader. State: Replica: fa3bb06de91d4ce98848bc3015c748d5, State: Running, Role: LEADER
I20260924 12:52:23.380488 13252 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3bb06de91d4ce98848bc3015c748d5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42701 } }
I20260924 12:52:23.381040 13247 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:23.384380 13253 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa3bb06de91d4ce98848bc3015c748d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3bb06de91d4ce98848bc3015c748d5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42701 } } }
I20260924 12:52:23.384166 13254 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa3bb06de91d4ce98848bc3015c748d5. Latest consensus state: current_term: 1 leader_uuid: "fa3bb06de91d4ce98848bc3015c748d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3bb06de91d4ce98848bc3015c748d5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42701 } } }
I20260924 12:52:23.402453 13253 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:23.402467 13254 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:23.405637 13261 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:23.411836 13261 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:23.421670 13261 catalog_manager.cc:1347] Generated new cluster ID: 7ab5362f0df14fa4949c973754487508
I20260924 12:52:23.421831 13261 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:23.442936 13261 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:23.444777 13261 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:23.451771 13261 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5: Generated new TSK 0
I20260924 12:52:23.452708 13261 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:52:23.514753 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42701
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:23.897648 13273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:23.898000 13273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:23.898168 13273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:23.905880 13273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:23.906049 13273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:23.906191 13273 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260924 12:52:23.906281 13273 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 12:52:23.906425 13273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:52:23.916662 13273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.49.126:42701
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:23.918092 13273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:23.919435 13273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:23.934077 13279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:23.934134 13278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:23.935456 13281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:23.936677 13273 server_base.cc:1034] running on GCE node
I20260924 12:52:23.937422 13273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:23.938512 13273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:23.939806 13273 hybrid_clock.cc:648] HybridClock initialized: now 1790254343939752 us; error 50 us; skew 500 ppm
I20260924 12:52:23.940182 13273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:23 dist-test-slave-m9hg krb5kdc[13157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254343, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:23.943961 13273 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:52:23.945964 13273 webserver.cc:460] Webserver started at http://127.11.49.65:39817/ using document root <none> and password file <none>
I20260924 12:52:23.946774 13273 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:23.946930 13273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:23.947261 13273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:23.950456 13273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "344ed448fc284d628684c27941ffaa7b"
format_stamp: "Formatted at 2026-09-24 12:52:23 on dist-test-slave-m9hg"
server_key: "3800cc5f83d0eca6ee324add444dbfe8"
server_key_iv: "e21e134c5ae6f6b51f38e5c7f66b872a"
server_key_version: "encryptionkey@0"
I20260924 12:52:23.951411 13273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "344ed448fc284d628684c27941ffaa7b"
format_stamp: "Formatted at 2026-09-24 12:52:23 on dist-test-slave-m9hg"
server_key: "3800cc5f83d0eca6ee324add444dbfe8"
server_key_iv: "e21e134c5ae6f6b51f38e5c7f66b872a"
server_key_version: "encryptionkey@0"
I20260924 12:52:23.957845 13273 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260924 12:52:23.962257 13288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:23.964061 13273 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:52:23.964416 13273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "344ed448fc284d628684c27941ffaa7b"
format_stamp: "Formatted at 2026-09-24 12:52:23 on dist-test-slave-m9hg"
server_key: "3800cc5f83d0eca6ee324add444dbfe8"
server_key_iv: "e21e134c5ae6f6b51f38e5c7f66b872a"
server_key_version: "encryptionkey@0"
I20260924 12:52:23.964648 13273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:23.978049 13273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:23.983362 13273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:23.983690 13273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:23.987062 13273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:23.987221 13273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:23.987360 13273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:23.987490 13273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 12:52:24 dist-test-slave-m9hg krb5kdc[13157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254343, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:24.020179 13297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:23.988310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:37413 (local address 127.11.49.126:42701)
0924 12:52:23.988876 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:23.988884 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:23.990552 (+ 1668us) server_negotiation.cc:407] Connection header received
0924 12:52:23.994332 (+ 3780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:23.994340 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:23.994459 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:23.994574 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:23.998038 (+ 3464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:23.999324 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.003118 (+ 3794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.003770 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.003947 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:24.010721 (+ 6774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:24.010728 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:24.010732 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:24.010781 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:24.014603 (+ 3822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:24.016688 (+ 2085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:24.016695 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:24.016697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:24.016907 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:24.017691 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:24.017696 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:24.017698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:24.018114 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:24.018287 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:24.019578 (+ 1291us) server_negotiation.cc:299] Negotiation successful
0924 12:52:24.019839 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":262,"threads_started":1}
I20260924 12:52:24.022440 13298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:23.989203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42701 (local address 127.11.49.65:37413)
0924 12:52:23.990295 (+ 1092us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:23.990369 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:23.993808 (+ 3439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:23.995271 (+ 1463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:23.995290 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:23.996460 (+ 1170us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:23.997743 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:23.997773 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:23.999524 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:23.999529 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:24.002831 (+ 3302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:24.002855 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.004144 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.004155 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:24.004598 (+ 443us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:24.005740 (+ 1142us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:24.005785 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:24.010284 (+ 4499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:24.014885 (+ 4601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:24.014904 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:24.014938 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:24.016404 (+ 1466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:24.017076 (+ 672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:24.017084 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:24.017091 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:24.017479 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:24.018280 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:24.018292 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:24.018984 (+ 692us) client_negotiation.cc:769] Sending connection context
0924 12:52:24.019425 (+ 441us) client_negotiation.cc:240] Negotiation successful
0924 12:52:24.020212 (+ 787us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"thread_start_us":423,"threads_started":1}
I20260924 12:52:24.050477 13372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:24.031493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42701 (local address 127.11.49.65:54049)
0924 12:52:24.032455 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:24.032488 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:24.032730 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:24.033293 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:24.033298 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:24.033882 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:24.034233 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:24.034244 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.035767 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.035781 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:24.037417 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:24.037473 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.038711 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.038719 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:24.038993 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:24.040062 (+ 1069us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:24.040102 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:24.041851 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:24.046072 (+ 4221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:24.046081 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:24.046089 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:24.046881 (+ 792us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:24.047571 (+ 690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:24.047580 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:24.047586 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:24.047802 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:24.048697 (+ 895us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:24.048704 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:24.049059 (+ 355us) client_negotiation.cc:769] Sending connection context
0924 12:52:24.049258 (+ 199us) client_negotiation.cc:240] Negotiation successful
0924 12:52:24.049837 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":441,"threads_started":1}
I20260924 12:52:24.051738 13297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:24.031579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:54049 (local address 127.11.49.126:42701)
0924 12:52:24.031944 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:24.031956 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:24.032631 (+ 675us) server_negotiation.cc:407] Connection header received
0924 12:52:24.032972 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:24.032981 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:24.033100 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:24.033242 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:24.034428 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.035601 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.037718 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.038421 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.038586 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:24.042188 (+ 3602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:24.042194 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:24.042198 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:24.042248 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:24.045854 (+ 3606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:24.047156 (+ 1302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:24.047163 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:24.047166 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:24.047407 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:24.048007 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:24.048012 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:24.048015 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:24.048515 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:24.048716 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:24.051063 (+ 2347us) server_negotiation.cc:299] Negotiation successful
0924 12:52:24.051425 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260924 12:52:24.056013 13273 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:39953
I20260924 12:52:24.056063 13408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:39953 every 8 connection(s)
I20260924 12:52:24.057605 13273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:52:24.060593 13409 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42701
I20260924 12:52:24.060951 13409 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:24.061856 13409 heartbeater.cc:511] Master 127.11.49.126:42701 requested a full tablet report, sending...
I20260924 12:52:24.062043 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 13273
I20260924 12:52:24.062265 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:52:24.062948 11461 external_mini_cluster.cc:1428] Setting key 122ae675a9fac68cc41860f76e6795c2
I20260924 12:52:24.065027 13202 ts_manager.cc:194] Registered new tserver with Master: 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953)
I20260924 12:52:24.066788 13202 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:37413
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:52:24.113283 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42701
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:24.532955 13413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:24.533344 13413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:24.533533 13413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:24.541977 13413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:24.542188 13413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:24.542382 13413 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260924 12:52:24.542454 13413 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 12:52:24.542605 13413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:52:24.554718 13413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.49.126:42701
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:24.556752 13413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:24.558835 13413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:24.576260 13418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:24.576362 13419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:24.576362 13421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:24.577855 13413 server_base.cc:1034] running on GCE node
I20260924 12:52:24.578647 13413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:24.579825 13413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:24.583240 13413 hybrid_clock.cc:648] HybridClock initialized: now 1790254344583142 us; error 90 us; skew 500 ppm
I20260924 12:52:24.583736 13413 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:24 dist-test-slave-m9hg krb5kdc[13157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:24.588369 13413 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:52:24.590441 13413 webserver.cc:460] Webserver started at http://127.11.49.66:41455/ using document root <none> and password file <none>
I20260924 12:52:24.591365 13413 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:24.591511 13413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:24.591886 13413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:24.595830 13413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "243efc4817b54d66a47674d9784ae773"
format_stamp: "Formatted at 2026-09-24 12:52:24 on dist-test-slave-m9hg"
server_key: "2583e8a704ebd383ac1b9216d0b5f369"
server_key_iv: "57f4e4d782ce9cc463fa1487858301b9"
server_key_version: "encryptionkey@0"
I20260924 12:52:24.596967 13413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "243efc4817b54d66a47674d9784ae773"
format_stamp: "Formatted at 2026-09-24 12:52:24 on dist-test-slave-m9hg"
server_key: "2583e8a704ebd383ac1b9216d0b5f369"
server_key_iv: "57f4e4d782ce9cc463fa1487858301b9"
server_key_version: "encryptionkey@0"
I20260924 12:52:24.604544 13413 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260924 12:52:24.610610 13428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:24.612703 13413 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.007s sys 0.000s
I20260924 12:52:24.613024 13413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "243efc4817b54d66a47674d9784ae773"
format_stamp: "Formatted at 2026-09-24 12:52:24 on dist-test-slave-m9hg"
server_key: "2583e8a704ebd383ac1b9216d0b5f369"
server_key_iv: "57f4e4d782ce9cc463fa1487858301b9"
server_key_version: "encryptionkey@0"
I20260924 12:52:24.613293 13413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:24.631929 13413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:24.637921 13413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:24.638355 13413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:24.642024 13413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:24.642194 13413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:24.642377 13413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:24.642503 13413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 12:52:24 dist-test-slave-m9hg krb5kdc[13157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:24.671579 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:24.642667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:44943 (local address 127.11.49.126:42701)
0924 12:52:24.643530 (+ 863us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:24.643539 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:24.644628 (+ 1089us) server_negotiation.cc:407] Connection header received
0924 12:52:24.646864 (+ 2236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:24.646871 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:24.646971 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:24.647098 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:24.650872 (+ 3774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.651959 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.655140 (+ 3181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.655804 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.655965 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:24.663724 (+ 7759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:24.663731 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:24.663735 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:24.663778 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:24.667289 (+ 3511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:24.668722 (+ 1433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:24.668731 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:24.668735 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:24.668878 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:24.669545 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:24.669550 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:24.669555 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:24.669953 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:24.670138 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:24.670932 (+ 794us) server_negotiation.cc:299] Negotiation successful
0924 12:52:24.671182 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":576,"threads_started":1}
I20260924 12:52:24.672755 13438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:24.643313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42701 (local address 127.11.49.66:44943)
0924 12:52:24.644413 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:24.644474 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:24.646530 (+ 2056us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:24.647597 (+ 1067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:24.647612 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:24.649009 (+ 1397us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:24.650500 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:24.650560 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.652182 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.652187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:24.654909 (+ 2722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:24.654929 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.656134 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.656144 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:24.656503 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:24.657712 (+ 1209us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:24.657766 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:24.663220 (+ 5454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:24.667574 (+ 4354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:24.667595 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:24.667617 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:24.668551 (+ 934us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:24.668995 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:24.669002 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:24.669009 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:24.669358 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:24.670106 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:24.670116 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:24.670529 (+ 413us) client_negotiation.cc:769] Sending connection context
0924 12:52:24.670823 (+ 294us) client_negotiation.cc:240] Negotiation successful
0924 12:52:24.671414 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"thread_start_us":464,"threads_started":1}
I20260924 12:52:24.705677 13413 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:33295
I20260924 12:52:24.705904 13548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:33295 every 8 connection(s)
I20260924 12:52:24.706790 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:24.687910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:51081 (local address 127.11.49.126:42701)
0924 12:52:24.688202 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:24.688212 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:24.688367 (+ 155us) server_negotiation.cc:407] Connection header received
0924 12:52:24.688727 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:24.688736 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:24.688858 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:24.689037 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:24.690975 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.692436 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.694035 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.694758 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.694933 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:24.698530 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:24.698538 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:24.698543 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:24.698602 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:24.702791 (+ 4189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:24.703957 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:24.703966 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:24.703973 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:24.704153 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:24.704712 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:24.704716 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:24.704719 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:24.705225 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:24.705448 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:24.706166 (+ 718us) server_negotiation.cc:299] Negotiation successful
0924 12:52:24.706425 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260924 12:52:24.706843 13512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:24.687076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42701 (local address 127.11.49.66:51081)
0924 12:52:24.688196 (+ 1120us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:24.688217 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:24.688513 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:24.689117 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:24.689122 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:24.690010 (+ 888us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:24.690685 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:24.690710 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.692632 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.692640 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:24.693841 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:24.693858 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:24.695080 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:24.695086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:24.695252 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:24.696404 (+ 1152us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:24.696439 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:24.698086 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:24.703156 (+ 5070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:24.703169 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:24.703176 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:24.703763 (+ 587us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:24.704339 (+ 576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:24.704345 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:24.704349 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:24.704551 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:24.705396 (+ 845us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:24.705406 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:24.705799 (+ 393us) client_negotiation.cc:769] Sending connection context
0924 12:52:24.706012 (+ 213us) client_negotiation.cc:240] Negotiation successful
0924 12:52:24.706466 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"thread_start_us":566,"threads_started":1}
I20260924 12:52:24.707597 13413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:52:24.708792 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 13413
I20260924 12:52:24.709026 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:52:24.709774 11461 external_mini_cluster.cc:1428] Setting key 0fa9c28d2ec1f9a98631b83cfa9fd943
I20260924 12:52:24.712564 13549 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42701
I20260924 12:52:24.713032 13549 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:24.714264 13549 heartbeater.cc:511] Master 127.11.49.126:42701 requested a full tablet report, sending...
I20260924 12:52:24.720937 13202 ts_manager.cc:194] Registered new tserver with Master: 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295)
I20260924 12:52:24.721978 13202 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:44943
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:52:24.761169 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42701
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:52:25.070822 13409 heartbeater.cc:503] Master 127.11.49.126:42701 was elected leader, sending a full tablet report...
W20260924 12:52:25.121061 13553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:25.121412 13553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:25.121591 13553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:25.129489 13553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:25.129664 13553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:25.129887 13553 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260924 12:52:25.129983 13553 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 12:52:25.130089 13553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:52:25.140076 13553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.49.126:42701
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:25.141425 13553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:25.142696 13553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:25.157598 13559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:25.157740 13561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:25.157780 13558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:25.159260 13553 server_base.cc:1034] running on GCE node
I20260924 12:52:25.160118 13553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:25.161368 13553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:25.162611 13553 hybrid_clock.cc:648] HybridClock initialized: now 1790254345162561 us; error 43 us; skew 500 ppm
I20260924 12:52:25.163020 13553 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:25 dist-test-slave-m9hg krb5kdc[13157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254345, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:25.166754 13553 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:52:25.168731 13553 webserver.cc:460] Webserver started at http://127.11.49.67:36819/ using document root <none> and password file <none>
I20260924 12:52:25.169530 13553 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:25.169691 13553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:25.169958 13553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:25.173134 13553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "a04380b45c1a426dbf0faf7ef616fa24"
format_stamp: "Formatted at 2026-09-24 12:52:25 on dist-test-slave-m9hg"
server_key: "fa8fb92bc2ae49a11ead7257e45ea6c1"
server_key_iv: "8094432414f8d50cfd3475a8f281bee4"
server_key_version: "encryptionkey@0"
I20260924 12:52:25.174033 13553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "a04380b45c1a426dbf0faf7ef616fa24"
format_stamp: "Formatted at 2026-09-24 12:52:25 on dist-test-slave-m9hg"
server_key: "fa8fb92bc2ae49a11ead7257e45ea6c1"
server_key_iv: "8094432414f8d50cfd3475a8f281bee4"
server_key_version: "encryptionkey@0"
I20260924 12:52:25.180119 13553 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260924 12:52:25.184753 13568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:25.186823 13553 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:52:25.187072 13553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "a04380b45c1a426dbf0faf7ef616fa24"
format_stamp: "Formatted at 2026-09-24 12:52:25 on dist-test-slave-m9hg"
server_key: "fa8fb92bc2ae49a11ead7257e45ea6c1"
server_key_iv: "8094432414f8d50cfd3475a8f281bee4"
server_key_version: "encryptionkey@0"
I20260924 12:52:25.187319 13553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:25.225354 13553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:25.230818 13553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:25.231145 13553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:25.234601 13553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:25.234781 13553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:25.234951 13553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:25.235085 13553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Sep 24 12:52:25 dist-test-slave-m9hg krb5kdc[13157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254345, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:25.276171 13577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.235611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:34423 (local address 127.11.49.126:42701)
0924 12:52:25.236229 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:25.236237 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:25.238158 (+ 1921us) server_negotiation.cc:407] Connection header received
0924 12:52:25.241709 (+ 3551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:25.241719 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:25.241849 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:25.242011 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:25.245596 (+ 3585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.247135 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.251023 (+ 3888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.251929 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.252173 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.259310 (+ 7137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:25.259320 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:25.259327 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:25.259396 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:25.269857 (+ 10461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:25.271748 (+ 1891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:25.271759 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:25.271763 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:25.271999 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:25.272792 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:25.272797 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:25.272801 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:25.273221 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:25.273410 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:25.275260 (+ 1850us) server_negotiation.cc:299] Negotiation successful
0924 12:52:25.275666 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":301,"threads_started":1}
I20260924 12:52:25.278291 13578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.236593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42701 (local address 127.11.49.67:34423)
0924 12:52:25.237833 (+ 1240us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:25.237911 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:25.241119 (+ 3208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:25.242491 (+ 1372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:25.242514 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:25.243853 (+ 1339us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:25.245238 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.245287 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.247508 (+ 2221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.247523 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.250685 (+ 3162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.250721 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.252511 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.252521 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.252959 (+ 438us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.253943 (+ 984us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:25.253984 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:25.258722 (+ 4738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:25.270227 (+ 11505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:25.270246 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:25.270280 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:25.271373 (+ 1093us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:25.272177 (+ 804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:25.272184 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:25.272189 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:25.272617 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:25.273449 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:25.273460 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:25.274504 (+ 1044us) client_negotiation.cc:769] Sending connection context
0924 12:52:25.275091 (+ 587us) client_negotiation.cc:240] Negotiation successful
0924 12:52:25.275939 (+ 848us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"thread_start_us":558,"threads_started":1}
I20260924 12:52:25.285559 13553 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:40651
I20260924 12:52:25.285635 13685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:40651 every 8 connection(s)
I20260924 12:52:25.288009 13553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:52:25.291893 13686 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42701
I20260924 12:52:25.292547 13686 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:25.293737 13686 heartbeater.cc:511] Master 127.11.49.126:42701 requested a full tablet report, sending...
I20260924 12:52:25.296061 13202 ts_manager.cc:194] Registered new tserver with Master: a04380b45c1a426dbf0faf7ef616fa24 (127.11.49.67:40651)
I20260924 12:52:25.297276 13202 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:34423
I20260924 12:52:25.297509 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 13553
I20260924 12:52:25.297734 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:52:25.298409 11461 external_mini_cluster.cc:1428] Setting key d0a59301e884638b3487587dce748ceb
I20260924 12:52:25.302588 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:52:25.311064 13577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.294068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:47869 (local address 127.11.49.126:42701)
0924 12:52:25.294329 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:25.294339 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:25.295110 (+ 771us) server_negotiation.cc:407] Connection header received
0924 12:52:25.295308 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:25.295314 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:25.295423 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:25.295561 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:25.296960 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.298398 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.300304 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.300763 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.300922 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.303533 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:25.303540 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:25.303545 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:25.303599 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:25.307258 (+ 3659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:25.308460 (+ 1202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:25.308466 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:25.308469 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:25.308670 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:25.309178 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:25.309183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:25.309185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:25.309555 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:25.309780 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:25.310271 (+ 491us) server_negotiation.cc:299] Negotiation successful
0924 12:52:25.310557 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":91}
I20260924 12:52:25.311100 13690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.293960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42701 (local address 127.11.49.67:47869)
0924 12:52:25.294961 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:25.294982 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:25.295149 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:25.295666 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:25.295671 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:25.296355 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:25.296697 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.296711 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.298704 (+ 1993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.298708 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.300105 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.300121 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.300973 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.300980 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.301176 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.301888 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:25.301921 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:25.303099 (+ 1178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:25.307524 (+ 4425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:25.307533 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:25.307540 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:25.308208 (+ 668us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:25.308827 (+ 619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:25.308834 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:25.308841 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:25.309018 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:25.309735 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:25.309742 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:25.309938 (+ 196us) client_negotiation.cc:769] Sending connection context
0924 12:52:25.310106 (+ 168us) client_negotiation.cc:240] Negotiation successful
0924 12:52:25.310465 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":437,"threads_started":1}
Sep 24 12:52:25 dist-test-slave-m9hg krb5kdc[13157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 24 12:52:25 dist-test-slave-m9hg krb5kdc[13157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:25.366776 13577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.347739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46108 (local address 127.11.49.126:42701)
0924 12:52:25.347987 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:25.347991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:25.348502 (+ 511us) server_negotiation.cc:407] Connection header received
0924 12:52:25.348747 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:25.348752 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:25.348862 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:25.348987 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:25.350870 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.351758 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.353361 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.353786 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.353908 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.359414 (+ 5506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:25.359420 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:25.359424 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:25.359470 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:25.363071 (+ 3601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:25.364361 (+ 1290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:25.364368 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:25.364372 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:25.364543 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:25.365242 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:25.365256 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:25.365258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:25.365578 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:25.365842 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:25.366260 (+ 418us) server_negotiation.cc:299] Negotiation successful
0924 12:52:25.366444 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260924 12:52:25.373277 13202 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:52:25.382642 13202 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:52:25.412919 13704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.402211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:39953 (local address 127.0.0.1:43268)
0924 12:52:25.402988 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:25.403053 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:25.403206 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:25.404614 (+ 1408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:25.404619 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:25.404650 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:25.405154 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.405169 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.407434 (+ 2265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.407443 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.409752 (+ 2309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.409768 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.411756 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.411764 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.411943 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.411969 (+ 26us) client_negotiation.cc:769] Sending connection context
0924 12:52:25.412069 (+ 100us) client_negotiation.cc:240] Negotiation successful
0924 12:52:25.412391 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"mutex_wait_us":35,"thread_start_us":439,"threads_started":1}
I20260924 12:52:25.412894 13703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.401154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47718 (local address 127.11.49.66:33295)
0924 12:52:25.401840 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:25.401849 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:25.401885 (+ 36us) server_negotiation.cc:407] Connection header received
0924 12:52:25.402247 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:25.402258 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:25.402668 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:25.402947 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:25.404070 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.405751 (+ 1681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.409193 (+ 3442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.410882 (+ 1689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.411051 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.411334 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:25.412326 (+ 992us) server_negotiation.cc:299] Negotiation successful
0924 12:52:25.412565 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":359,"threads_started":1}
I20260924 12:52:25.413802 13702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.400877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:33295 (local address 127.0.0.1:47718)
0924 12:52:25.401691 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:25.401743 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:25.401943 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:25.403272 (+ 1329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:25.403280 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:25.403314 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:25.403850 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.403868 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.405950 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.405956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.408922 (+ 2966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.408943 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.411504 (+ 2561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.411525 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.411844 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.411916 (+ 72us) client_negotiation.cc:769] Sending connection context
0924 12:52:25.412076 (+ 160us) client_negotiation.cc:240] Negotiation successful
0924 12:52:25.413327 (+ 1251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"mutex_wait_us":983,"thread_start_us":371,"threads_started":1}
I20260924 12:52:25.415047 13705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.402563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43268 (local address 127.11.49.65:39953)
0924 12:52:25.403840 (+ 1277us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:25.403851 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:25.403887 (+ 36us) server_negotiation.cc:407] Connection header received
0924 12:52:25.404024 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:25.404034 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:25.404367 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:25.405396 (+ 1029us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:25.405621 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.407244 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.410044 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.411495 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.414313 (+ 2818us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.414562 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:25.414640 (+ 78us) server_negotiation.cc:299] Negotiation successful
0924 12:52:25.414806 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1056,"thread_start_us":883,"threads_started":1}
I20260924 12:52:25.421507 13339 tablet_service.cc:1467] Processing CreateTablet for tablet 8e336263a92e4f8c97c6e253a348d230 (DEFAULT_TABLE table=test-table [id=16e00da5988a4f41979d3c8dde99f9a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:25.421605 13479 tablet_service.cc:1467] Processing CreateTablet for tablet 8e336263a92e4f8c97c6e253a348d230 (DEFAULT_TABLE table=test-table [id=16e00da5988a4f41979d3c8dde99f9a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:25.423249 13339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e336263a92e4f8c97c6e253a348d230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:25.423964 13479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e336263a92e4f8c97c6e253a348d230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:25.425197 13704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.403794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:40651 (local address 127.0.0.1:55000)
0924 12:52:25.413247 (+ 9453us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:25.413272 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:25.413430 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:25.416876 (+ 3446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:25.416882 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:25.416926 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:25.417157 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.417173 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.420108 (+ 2935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.420115 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.422052 (+ 1937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.422078 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.424142 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.424150 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.424440 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.424486 (+ 46us) client_negotiation.cc:769] Sending connection context
0924 12:52:25.424625 (+ 139us) client_negotiation.cc:240] Negotiation successful
0924 12:52:25.424827 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9331,"thread_start_us":12692,"threads_started":1}
I20260924 12:52:25.425261 13707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.404035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55000 (local address 127.11.49.67:40651)
0924 12:52:25.416026 (+ 11991us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:25.416035 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:25.416073 (+ 38us) server_negotiation.cc:407] Connection header received
0924 12:52:25.416184 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:25.416191 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:25.416578 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:25.416789 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:25.417440 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.419884 (+ 2444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.422369 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.423896 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.424117 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.424419 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:25.424711 (+ 292us) server_negotiation.cc:299] Negotiation successful
0924 12:52:25.424889 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11778,"thread_start_us":11624,"threads_started":1}
I20260924 12:52:25.429760 13619 tablet_service.cc:1467] Processing CreateTablet for tablet 8e336263a92e4f8c97c6e253a348d230 (DEFAULT_TABLE table=test-table [id=16e00da5988a4f41979d3c8dde99f9a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:25.431435 13619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e336263a92e4f8c97c6e253a348d230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:25.443636 13708 tablet_bootstrap.cc:492] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: Bootstrap starting.
I20260924 12:52:25.451040 13708 tablet_bootstrap.cc:654] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:25.454203 13708 log.cc:824] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:25.454842 13710 tablet_bootstrap.cc:492] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: Bootstrap starting.
I20260924 12:52:25.455421 13709 tablet_bootstrap.cc:492] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: Bootstrap starting.
I20260924 12:52:25.460155 13710 tablet_bootstrap.cc:654] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:25.461660 13710 log.cc:824] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:25.460075 13709 tablet_bootstrap.cc:654] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:25.462654 13708 tablet_bootstrap.cc:492] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: No bootstrap required, opened a new log
I20260924 12:52:25.463109 13708 ts_tablet_manager.cc:1397] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.005s
I20260924 12:52:25.463799 13709 log.cc:824] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:25.465400 13710 tablet_bootstrap.cc:492] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: No bootstrap required, opened a new log
I20260924 12:52:25.465723 13710 ts_tablet_manager.cc:1397] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260924 12:52:25.468534 13709 tablet_bootstrap.cc:492] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: No bootstrap required, opened a new log
I20260924 12:52:25.469184 13709 ts_tablet_manager.cc:1397] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260924 12:52:25.476034 13708 raft_consensus.cc:348] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.476765 13708 raft_consensus.cc:374] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:25.476883 13708 raft_consensus.cc:729] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344ed448fc284d628684c27941ffaa7b, State: Initialized, Role: FOLLOWER
I20260924 12:52:25.477779 13708 consensus_queue.cc:260] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.478183 13710 raft_consensus.cc:348] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.478791 13710 raft_consensus.cc:374] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:25.478899 13710 raft_consensus.cc:729] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04380b45c1a426dbf0faf7ef616fa24, State: Initialized, Role: FOLLOWER
I20260924 12:52:25.479724 13710 consensus_queue.cc:260] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.480149 13708 ts_tablet_manager.cc:1428] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: Time spent starting tablet: real 0.017s user 0.012s sys 0.004s
I20260924 12:52:25.481853 13686 heartbeater.cc:503] Master 127.11.49.126:42701 was elected leader, sending a full tablet report...
I20260924 12:52:25.482735 13710 ts_tablet_manager.cc:1428] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: Time spent starting tablet: real 0.017s user 0.015s sys 0.003s
I20260924 12:52:25.488160 13709 raft_consensus.cc:348] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.488737 13709 raft_consensus.cc:374] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:25.488847 13709 raft_consensus.cc:729] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 243efc4817b54d66a47674d9784ae773, State: Initialized, Role: FOLLOWER
I20260924 12:52:25.489523 13709 consensus_queue.cc:260] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.491496 13549 heartbeater.cc:503] Master 127.11.49.126:42701 was elected leader, sending a full tablet report...
I20260924 12:52:25.492008 13709 ts_tablet_manager.cc:1428] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: Time spent starting tablet: real 0.023s user 0.015s sys 0.000s
W20260924 12:52:25.540902 13687 tablet.cc:2369] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:52:25.560719 13410 tablet.cc:2369] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:52:25.677496 13715 raft_consensus.cc:482] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:52:25.678009 13715 raft_consensus.cc:504] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.680184 13715 leader_election.cc:288] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295), 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953)
I20260924 12:52:25.688850 13578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.680675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:33295 (local address 127.11.49.67:39319)
0924 12:52:25.681026 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:25.681053 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:25.681253 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:25.681794 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:25.681820 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:25.681929 (+ 109us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:25.682150 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.682161 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.683737 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.683742 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.685902 (+ 2160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.685920 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.687927 (+ 2007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.687932 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.688147 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.688192 (+ 45us) client_negotiation.cc:769] Sending connection context
0924 12:52:25.688345 (+ 153us) client_negotiation.cc:240] Negotiation successful
0924 12:52:25.688501 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":4}
I20260924 12:52:25.688885 13703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.681016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:39319 (local address 127.11.49.66:33295)
0924 12:52:25.681296 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:25.681305 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:25.681330 (+ 25us) server_negotiation.cc:407] Connection header received
0924 12:52:25.681429 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:25.681437 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:25.681538 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:25.681666 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:25.682427 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.683469 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.686193 (+ 2724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.687524 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.687758 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.687865 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:25.688421 (+ 556us) server_negotiation.cc:299] Negotiation successful
0924 12:52:25.688557 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260924 12:52:25.689168 13705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.681339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:52719 (local address 127.11.49.65:39953)
0924 12:52:25.681651 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:25.681658 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:25.682145 (+ 487us) server_negotiation.cc:407] Connection header received
0924 12:52:25.682370 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:25.682376 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:25.682485 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:25.682596 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:25.683231 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.684219 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.686639 (+ 2420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.688033 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.688182 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.688239 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:25.688659 (+ 420us) server_negotiation.cc:299] Negotiation successful
0924 12:52:25.688812 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260924 12:52:25.689191 13717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.681170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:39953 (local address 127.11.49.67:52719)
0924 12:52:25.682020 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:25.682042 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:25.682202 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:25.682640 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:25.682645 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:25.682697 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:25.683048 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.683057 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.684468 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.684475 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.686443 (+ 1968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.686453 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.688306 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.688315 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.688486 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.688513 (+ 27us) client_negotiation.cc:769] Sending connection context
0924 12:52:25.688608 (+ 95us) client_negotiation.cc:240] Negotiation successful
0924 12:52:25.688736 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":423,"threads_started":1}
I20260924 12:52:25.690310 13359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e336263a92e4f8c97c6e253a348d230" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344ed448fc284d628684c27941ffaa7b" is_pre_election: true
I20260924 12:52:25.690657 13503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e336263a92e4f8c97c6e253a348d230" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243efc4817b54d66a47674d9784ae773" is_pre_election: true
I20260924 12:52:25.690896 13359 raft_consensus.cc:2454] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 0.
I20260924 12:52:25.691311 13503 raft_consensus.cc:2454] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 0.
I20260924 12:52:25.691686 13571 leader_election.cc:302] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344ed448fc284d628684c27941ffaa7b, a04380b45c1a426dbf0faf7ef616fa24; no voters:
I20260924 12:52:25.692162 13715 raft_consensus.cc:2781] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:52:25.692459 13715 raft_consensus.cc:482] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:52:25.692575 13715 raft_consensus.cc:3037] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:25.695220 13715 raft_consensus.cc:504] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.696100 13715 leader_election.cc:288] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 election: Requested vote from peers 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295), 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953)
I20260924 12:52:25.696949 13503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e336263a92e4f8c97c6e253a348d230" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243efc4817b54d66a47674d9784ae773"
I20260924 12:52:25.697048 13359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e336263a92e4f8c97c6e253a348d230" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344ed448fc284d628684c27941ffaa7b"
I20260924 12:52:25.697252 13503 raft_consensus.cc:3037] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:25.697366 13359 raft_consensus.cc:3037] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:25.700095 13503 raft_consensus.cc:2454] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 1.
I20260924 12:52:25.700582 13359 raft_consensus.cc:2454] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 1.
I20260924 12:52:25.701005 13571 leader_election.cc:302] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 243efc4817b54d66a47674d9784ae773, a04380b45c1a426dbf0faf7ef616fa24; no voters:
I20260924 12:52:25.701522 13715 raft_consensus.cc:2781] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:25.702212 13715 raft_consensus.cc:686] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 LEADER]: Becoming Leader. State: Replica: a04380b45c1a426dbf0faf7ef616fa24, State: Running, Role: LEADER
I20260924 12:52:25.702808 13715 consensus_queue.cc:237] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.708240 13202 catalog_manager.cc:5495] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 reported cstate change: term changed from 0 to 1, leader changed from <none> to a04380b45c1a426dbf0faf7ef616fa24 (127.11.49.67). New cstate: current_term: 1 leader_uuid: "a04380b45c1a426dbf0faf7ef616fa24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } health_report { overall_health: HEALTHY } } }
W20260924 12:52:25.715317 13550 tablet.cc:2369] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 24 12:52:25 dist-test-slave-m9hg krb5kdc[13157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254343, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:25.770771 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.755111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42701 (local address 127.0.0.1:46118)
0924 12:52:25.755868 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:25.755886 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:25.756100 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:25.756532 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:25.756538 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:25.757309 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:25.757578 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.757588 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.758707 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.758715 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.759771 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.759783 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.760695 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.760701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.760858 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.761775 (+ 917us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:25.761798 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:25.764385 (+ 2587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:25.767589 (+ 3204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:25.767603 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:25.767611 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:25.768115 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:25.768550 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:25.768554 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:25.768558 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:25.768690 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:25.769433 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:25.769446 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:25.769743 (+ 297us) client_negotiation.cc:769] Sending connection context
0924 12:52:25.769944 (+ 201us) client_negotiation.cc:240] Negotiation successful
0924 12:52:25.770263 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":411,"threads_started":1}
I20260924 12:52:25.770794 13577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.755075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.11.49.126:42701)
0924 12:52:25.755271 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:25.755280 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:25.756008 (+ 728us) server_negotiation.cc:407] Connection header received
0924 12:52:25.756249 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:25.756255 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:25.756371 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:25.756492 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:25.757744 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.758559 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.759942 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.760486 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.760632 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.764596 (+ 3964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:25.764601 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:25.764604 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:25.764635 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:25.767402 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:25.768262 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:25.768307 (+ 45us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:25.768311 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:25.768433 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:25.768801 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:25.768806 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:25.768815 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:25.769072 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:25.769254 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:25.770068 (+ 814us) server_negotiation.cc:299] Negotiation successful
0924 12:52:25.770405 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":136,"server-negotiator.queue_time_us":73}
I20260924 12:52:25.777830 13202 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:46118:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260924 12:52:25.779054 13202 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:52:25.788762 13339 tablet_service.cc:1467] Processing CreateTablet for tablet eea922e4fb1e41ef8d7f845e82e252c8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e91d6d498fb14b7e9c5ea97bbb1457d9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 12:52:25.789702 13339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eea922e4fb1e41ef8d7f845e82e252c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:25.789110 13619 tablet_service.cc:1467] Processing CreateTablet for tablet eea922e4fb1e41ef8d7f845e82e252c8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e91d6d498fb14b7e9c5ea97bbb1457d9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 12:52:25.788973 13479 tablet_service.cc:1467] Processing CreateTablet for tablet eea922e4fb1e41ef8d7f845e82e252c8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e91d6d498fb14b7e9c5ea97bbb1457d9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 12:52:25.790223 13479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eea922e4fb1e41ef8d7f845e82e252c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:25.790223 13619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eea922e4fb1e41ef8d7f845e82e252c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:25.796203 13708 tablet_bootstrap.cc:492] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b: Bootstrap starting.
I20260924 12:52:25.797952 13708 tablet_bootstrap.cc:654] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:25.798988 13710 tablet_bootstrap.cc:492] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: Bootstrap starting.
I20260924 12:52:25.799062 13709 tablet_bootstrap.cc:492] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773: Bootstrap starting.
I20260924 12:52:25.800522 13709 tablet_bootstrap.cc:654] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:25.800696 13710 tablet_bootstrap.cc:654] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:25.803700 13708 tablet_bootstrap.cc:492] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b: No bootstrap required, opened a new log
I20260924 12:52:25.803969 13708 ts_tablet_manager.cc:1397] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260924 12:52:25.805284 13708 raft_consensus.cc:348] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.805677 13708 raft_consensus.cc:374] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:25.805809 13708 raft_consensus.cc:729] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344ed448fc284d628684c27941ffaa7b, State: Initialized, Role: FOLLOWER
I20260924 12:52:25.806174 13708 consensus_queue.cc:260] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.806941 13714 tablet_replica.cc:439] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } } }
I20260924 12:52:25.807430 13714 tablet_replica.cc:442] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:25.807857 13708 ts_tablet_manager.cc:1428] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260924 12:52:25.811506 13709 tablet_bootstrap.cc:492] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773: No bootstrap required, opened a new log
I20260924 12:52:25.811707 13709 ts_tablet_manager.cc:1397] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.008s
I20260924 12:52:25.812664 13709 raft_consensus.cc:348] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.812876 13709 raft_consensus.cc:374] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:25.812973 13709 raft_consensus.cc:729] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 243efc4817b54d66a47674d9784ae773, State: Initialized, Role: FOLLOWER
I20260924 12:52:25.813256 13709 consensus_queue.cc:260] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.813789 13716 tablet_replica.cc:439] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } } }
I20260924 12:52:25.814250 13716 tablet_replica.cc:442] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:25.814733 13709 ts_tablet_manager.cc:1428] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260924 12:52:25.816687 13710 tablet_bootstrap.cc:492] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: No bootstrap required, opened a new log
I20260924 12:52:25.816908 13710 ts_tablet_manager.cc:1397] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.005s
I20260924 12:52:25.817987 13710 raft_consensus.cc:348] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.818254 13710 raft_consensus.cc:374] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:25.818358 13710 raft_consensus.cc:729] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04380b45c1a426dbf0faf7ef616fa24, State: Initialized, Role: FOLLOWER
I20260924 12:52:25.818655 13710 consensus_queue.cc:260] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.819396 13710 ts_tablet_manager.cc:1428] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260924 12:52:25.819274 13715 tablet_replica.cc:439] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } } }
I20260924 12:52:25.819693 13715 tablet_replica.cc:442] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:25.916718 13715 raft_consensus.cc:482] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:52:25.917054 13715 raft_consensus.cc:504] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.917874 13715 leader_election.cc:288] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953), 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295)
I20260924 12:52:25.918643 13359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eea922e4fb1e41ef8d7f845e82e252c8" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344ed448fc284d628684c27941ffaa7b" is_pre_election: true
I20260924 12:52:25.918931 13359 raft_consensus.cc:2454] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 0.
I20260924 12:52:25.918862 13503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eea922e4fb1e41ef8d7f845e82e252c8" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243efc4817b54d66a47674d9784ae773" is_pre_election: true
I20260924 12:52:25.919266 13503 raft_consensus.cc:2454] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 0.
I20260924 12:52:25.919467 13571 leader_election.cc:302] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344ed448fc284d628684c27941ffaa7b, a04380b45c1a426dbf0faf7ef616fa24; no voters:
I20260924 12:52:25.919907 13715 raft_consensus.cc:2781] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:52:25.920014 13715 raft_consensus.cc:482] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:52:25.920125 13715 raft_consensus.cc:3037] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:25.922346 13715 raft_consensus.cc:504] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.923005 13715 leader_election.cc:288] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 election: Requested vote from peers 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953), 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295)
I20260924 12:52:25.924042 13503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eea922e4fb1e41ef8d7f845e82e252c8" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243efc4817b54d66a47674d9784ae773"
I20260924 12:52:25.924042 13359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eea922e4fb1e41ef8d7f845e82e252c8" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344ed448fc284d628684c27941ffaa7b"
I20260924 12:52:25.924454 13503 raft_consensus.cc:3037] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:25.924439 13359 raft_consensus.cc:3037] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:25.928551 13359 raft_consensus.cc:2454] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 1.
I20260924 12:52:25.928551 13503 raft_consensus.cc:2454] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 1.
I20260924 12:52:25.929350 13571 leader_election.cc:302] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344ed448fc284d628684c27941ffaa7b, a04380b45c1a426dbf0faf7ef616fa24; no voters:
I20260924 12:52:25.929816 13715 raft_consensus.cc:2781] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:25.930238 13715 raft_consensus.cc:686] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 LEADER]: Becoming Leader. State: Replica: a04380b45c1a426dbf0faf7ef616fa24, State: Running, Role: LEADER
I20260924 12:52:25.930644 13715 consensus_queue.cc:237] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:25.932963 13718 tablet_replica.cc:439] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: TxnStatusTablet state changed. Reason: New leader a04380b45c1a426dbf0faf7ef616fa24. Latest consensus state: current_term: 1 leader_uuid: "a04380b45c1a426dbf0faf7ef616fa24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } } }
I20260924 12:52:25.933275 13718 tablet_replica.cc:442] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: This TxnStatusTablet replica's current role is: LEADER
I20260924 12:52:25.934052 13730 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260924 12:52:25.934437 13730 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260924 12:52:25.935041 13202 catalog_manager.cc:5495] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 reported cstate change: term changed from 0 to 1, leader changed from <none> to a04380b45c1a426dbf0faf7ef616fa24 (127.11.49.67). New cstate: current_term: 1 leader_uuid: "a04380b45c1a426dbf0faf7ef616fa24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } health_report { overall_health: HEALTHY } } }
I20260924 12:52:25.966459 13733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.957855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55016 (local address 127.11.49.67:40651)
0924 12:52:25.958872 (+ 1017us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:25.958879 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:25.958910 (+ 31us) server_negotiation.cc:407] Connection header received
0924 12:52:25.959023 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:25.959028 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:25.959149 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:25.959369 (+ 220us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:52:25.959940 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.961213 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.962956 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.963723 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.963877 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.964583 (+ 706us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:52:25.965513 (+ 930us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:52:25.965680 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:25.965919 (+ 239us) server_negotiation.cc:299] Negotiation successful
0924 12:52:25.966018 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":639,"threads_started":1}
I20260924 12:52:25.966578 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:25.957553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:40651 (local address 127.0.0.1:55016)
0924 12:52:25.957882 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:25.957908 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:25.958151 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:25.959487 (+ 1336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:25.959492 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:25.959508 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 12:52:25.959742 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.959750 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.961449 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.961455 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.962745 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:25.962768 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:25.963935 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:25.963940 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:25.964138 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:25.964228 (+ 90us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 12:52:25.965697 (+ 1469us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 12:52:25.965748 (+ 51us) client_negotiation.cc:769] Sending connection context
0924 12:52:25.965861 (+ 113us) client_negotiation.cc:240] Negotiation successful
0924 12:52:25.966130 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260924 12:52:25.978072 13503 raft_consensus.cc:1261] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Refusing update from remote peer a04380b45c1a426dbf0faf7ef616fa24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:25.978072 13359 raft_consensus.cc:1261] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Refusing update from remote peer a04380b45c1a426dbf0faf7ef616fa24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:25.979494 13715 consensus_queue.cc:1035] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:25.980019 13718 consensus_queue.cc:1035] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:25.998770 13714 tablet_replica.cc:439] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b: TxnStatusTablet state changed. Reason: New leader a04380b45c1a426dbf0faf7ef616fa24. Latest consensus state: current_term: 1 leader_uuid: "a04380b45c1a426dbf0faf7ef616fa24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } } }
I20260924 12:52:25.999147 13714 tablet_replica.cc:442] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:26.002214 13734 mvcc.cc:205] Tried to move back new op lower bound from 7332881801110618112 to 7332881800934850560. Current Snapshot: MvccSnapshot[applied={T|T < 7332881801110618112}]
I20260924 12:52:26.006596 13735 mvcc.cc:205] Tried to move back new op lower bound from 7332881801110618112 to 7332881800934850560. Current Snapshot: MvccSnapshot[applied={T|T < 7332881801110618112}]
I20260924 12:52:26.009016 13718 tablet_replica.cc:439] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a04380b45c1a426dbf0faf7ef616fa24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } } }
I20260924 12:52:26.009526 13718 tablet_replica.cc:442] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: This TxnStatusTablet replica's current role is: LEADER
I20260924 12:52:26.009944 13716 tablet_replica.cc:439] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773: TxnStatusTablet state changed. Reason: New leader a04380b45c1a426dbf0faf7ef616fa24. Latest consensus state: current_term: 1 leader_uuid: "a04380b45c1a426dbf0faf7ef616fa24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } } }
I20260924 12:52:26.010294 13716 tablet_replica.cc:442] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:26.010521 13714 tablet_replica.cc:439] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a04380b45c1a426dbf0faf7ef616fa24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } } }
I20260924 12:52:26.010811 13714 tablet_replica.cc:442] T eea922e4fb1e41ef8d7f845e82e252c8 P 344ed448fc284d628684c27941ffaa7b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:26.017659 13715 tablet_replica.cc:439] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a04380b45c1a426dbf0faf7ef616fa24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } } }
I20260924 12:52:26.018115 13715 tablet_replica.cc:442] T eea922e4fb1e41ef8d7f845e82e252c8 P a04380b45c1a426dbf0faf7ef616fa24: This TxnStatusTablet replica's current role is: LEADER
I20260924 12:52:26.022846 13716 tablet_replica.cc:439] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a04380b45c1a426dbf0faf7ef616fa24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } } }
I20260924 12:52:26.023182 13716 tablet_replica.cc:442] T eea922e4fb1e41ef8d7f845e82e252c8 P 243efc4817b54d66a47674d9784ae773: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:52:26.035285 13733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:26.024032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55026 (local address 127.11.49.67:40651)
0924 12:52:26.024316 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:26.024324 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:26.029300 (+ 4976us) server_negotiation.cc:407] Connection header received
0924 12:52:26.029580 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:26.029586 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:26.029710 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:26.029895 (+ 185us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:52:26.030474 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:26.031361 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:26.033135 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:26.033635 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:26.033806 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:26.034311 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:52:26.034465 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:52:26.034584 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:26.034745 (+ 161us) server_negotiation.cc:299] Negotiation successful
0924 12:52:26.034857 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260924 12:52:26.058454 13733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:26.051572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:46681 (local address 127.11.49.67:40651)
0924 12:52:26.051858 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:26.051863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:26.052632 (+ 769us) server_negotiation.cc:407] Connection header received
0924 12:52:26.052900 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:26.052905 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:26.052980 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:26.053103 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:52:26.053712 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:26.054586 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:26.056261 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:26.056804 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:26.056964 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:26.057464 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:52:26.057605 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:52:26.057706 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:26.057833 (+ 127us) server_negotiation.cc:299] Negotiation successful
0924 12:52:26.057944 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":75}
I20260924 12:52:26.058511 13746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:26.051700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:40651 (local address 127.11.49.67:46681)
0924 12:52:26.052470 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:26.052494 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:26.052750 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:26.053115 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:26.053120 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:26.053130 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 12:52:26.053561 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:26.053571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:26.054754 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:26.054765 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:26.056111 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:26.056123 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:26.057024 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:26.057031 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:26.057165 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:26.057237 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 12:52:26.057702 (+ 465us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 12:52:26.057712 (+ 10us) client_negotiation.cc:769] Sending connection context
0924 12:52:26.057815 (+ 103us) client_negotiation.cc:240] Negotiation successful
0924 12:52:26.058036 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"mutex_wait_us":62,"thread_start_us":335,"threads_started":1}
I20260924 12:52:26.076810 13503 raft_consensus.cc:1261] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Refusing update from remote peer a04380b45c1a426dbf0faf7ef616fa24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:26.077111 13359 raft_consensus.cc:1261] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Refusing update from remote peer a04380b45c1a426dbf0faf7ef616fa24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:26.078588 13715 consensus_queue.cc:1035] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:26.079285 13747 consensus_queue.cc:1035] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:26.165068 13201 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:26.165409 13201 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:26.170449 13201 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5: Sending DeleteTablet for 3 replicas of tablet 8e336263a92e4f8c97c6e253a348d230
I20260924 12:52:26.171993 13339 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e336263a92e4f8c97c6e253a348d230 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:26 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:43268
I20260924 12:52:26.172078 13479 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e336263a92e4f8c97c6e253a348d230 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:26 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:47718
I20260924 12:52:26.173444 13618 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e336263a92e4f8c97c6e253a348d230 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:26 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:55000
I20260924 12:52:26.174095 13201 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:52:26.174870 13201 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:52:26.175086 13752 tablet_replica.cc:330] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: stopping tablet replica
I20260924 12:52:26.176312 13752 raft_consensus.cc:2229] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:26.177177 13752 raft_consensus.cc:2258] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:26.180394 13752 ts_tablet_manager.cc:1905] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:26.185254 13751 tablet_replica.cc:330] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: stopping tablet replica
I20260924 12:52:26.185520 13479 tablet_service.cc:1467] Processing CreateTablet for tablet cb103755a5864045975a8098938d17cb (DEFAULT_TABLE table=test-table [id=93e520ce290f467eaca0f7094fa83fb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:26.185608 13619 tablet_service.cc:1467] Processing CreateTablet for tablet cb103755a5864045975a8098938d17cb (DEFAULT_TABLE table=test-table [id=93e520ce290f467eaca0f7094fa83fb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:26.186187 13619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb103755a5864045975a8098938d17cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:26.186275 13479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb103755a5864045975a8098938d17cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:26.190598 13751 raft_consensus.cc:2229] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:26.191510 13751 raft_consensus.cc:2258] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:26.192902 13338 tablet_service.cc:1467] Processing CreateTablet for tablet cb103755a5864045975a8098938d17cb (DEFAULT_TABLE table=test-table [id=93e520ce290f467eaca0f7094fa83fb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:26.193470 13338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb103755a5864045975a8098938d17cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:26.195747 13751 ts_tablet_manager.cc:1905] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:26.198894 13752 ts_tablet_manager.cc:1918] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:52:26.207923 13708 tablet_bootstrap.cc:492] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b: Bootstrap starting.
I20260924 12:52:26.201452 13709 tablet_bootstrap.cc:492] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773: Bootstrap starting.
I20260924 12:52:26.208490 13752 log.cc:1196] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/8e336263a92e4f8c97c6e253a348d230
I20260924 12:52:26.209287 13752 ts_tablet_manager.cc:1939] T 8e336263a92e4f8c97c6e253a348d230 P 243efc4817b54d66a47674d9784ae773: Deleting consensus metadata
I20260924 12:52:26.210726 13709 tablet_bootstrap.cc:654] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:26.211323 13710 tablet_bootstrap.cc:492] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24: Bootstrap starting.
I20260924 12:52:26.212003 13753 tablet_replica.cc:330] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: stopping tablet replica
I20260924 12:52:26.212517 13753 raft_consensus.cc:2229] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:52:26.213203 13753 raft_consensus.cc:2258] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:26.213652 13708 tablet_bootstrap.cc:654] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:26.213658 13710 tablet_bootstrap.cc:654] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:26.217083 13753 ts_tablet_manager.cc:1905] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:26.220482 13188 catalog_manager.cc:4841] TS 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295): tablet 8e336263a92e4f8c97c6e253a348d230 (table test-table [id=16e00da5988a4f41979d3c8dde99f9a3]) successfully deleted
I20260924 12:52:26.225095 13709 tablet_bootstrap.cc:492] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773: No bootstrap required, opened a new log
I20260924 12:52:26.225404 13709 ts_tablet_manager.cc:1397] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.002s
I20260924 12:52:26.226213 13751 ts_tablet_manager.cc:1918] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:52:26.226428 13751 log.cc:1196] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/8e336263a92e4f8c97c6e253a348d230
I20260924 12:52:26.227102 13751 ts_tablet_manager.cc:1939] T 8e336263a92e4f8c97c6e253a348d230 P 344ed448fc284d628684c27941ffaa7b: Deleting consensus metadata
I20260924 12:52:26.227072 13753 ts_tablet_manager.cc:1918] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:52:26.227243 13753 log.cc:1196] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/8e336263a92e4f8c97c6e253a348d230
I20260924 12:52:26.227995 13753 ts_tablet_manager.cc:1939] T 8e336263a92e4f8c97c6e253a348d230 P a04380b45c1a426dbf0faf7ef616fa24: Deleting consensus metadata
I20260924 12:52:26.229143 13709 raft_consensus.cc:348] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:26.229353 13188 catalog_manager.cc:4841] TS 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953): tablet 8e336263a92e4f8c97c6e253a348d230 (table test-table [id=16e00da5988a4f41979d3c8dde99f9a3]) successfully deleted
I20260924 12:52:26.229506 13709 raft_consensus.cc:374] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:26.229588 13709 raft_consensus.cc:729] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 243efc4817b54d66a47674d9784ae773, State: Initialized, Role: FOLLOWER
I20260924 12:52:26.229813 13710 tablet_bootstrap.cc:492] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24: No bootstrap required, opened a new log
I20260924 12:52:26.229804 13188 catalog_manager.cc:4841] TS a04380b45c1a426dbf0faf7ef616fa24 (127.11.49.67:40651): tablet 8e336263a92e4f8c97c6e253a348d230 (table test-table [id=16e00da5988a4f41979d3c8dde99f9a3]) successfully deleted
I20260924 12:52:26.229950 13709 consensus_queue.cc:260] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:26.230404 13710 ts_tablet_manager.cc:1397] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.010s
I20260924 12:52:26.231464 13708 tablet_bootstrap.cc:492] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b: No bootstrap required, opened a new log
I20260924 12:52:26.231667 13708 ts_tablet_manager.cc:1397] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.003s
I20260924 12:52:26.231650 13710 raft_consensus.cc:348] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:26.232044 13710 raft_consensus.cc:374] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:26.232187 13710 raft_consensus.cc:729] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04380b45c1a426dbf0faf7ef616fa24, State: Initialized, Role: FOLLOWER
I20260924 12:52:26.232537 13708 raft_consensus.cc:348] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:26.232815 13708 raft_consensus.cc:374] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:26.232908 13708 raft_consensus.cc:729] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344ed448fc284d628684c27941ffaa7b, State: Initialized, Role: FOLLOWER
I20260924 12:52:26.232635 13710 consensus_queue.cc:260] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:26.233240 13708 consensus_queue.cc:260] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:26.233836 13708 ts_tablet_manager.cc:1428] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 12:52:26.234748 13710 ts_tablet_manager.cc:1428] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260924 12:52:26.235196 13709 ts_tablet_manager.cc:1428] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20260924 12:52:26.334914 13715 raft_consensus.cc:482] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:52:26.335233 13715 raft_consensus.cc:504] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:26.336107 13715 leader_election.cc:288] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953), 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295)
I20260924 12:52:26.336987 13502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb103755a5864045975a8098938d17cb" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243efc4817b54d66a47674d9784ae773" is_pre_election: true
I20260924 12:52:26.336989 13359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb103755a5864045975a8098938d17cb" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344ed448fc284d628684c27941ffaa7b" is_pre_election: true
I20260924 12:52:26.337296 13502 raft_consensus.cc:2454] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 0.
I20260924 12:52:26.337296 13359 raft_consensus.cc:2454] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 0.
I20260924 12:52:26.337913 13571 leader_election.cc:302] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344ed448fc284d628684c27941ffaa7b, a04380b45c1a426dbf0faf7ef616fa24; no voters:
I20260924 12:52:26.338279 13715 raft_consensus.cc:2781] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:52:26.338415 13715 raft_consensus.cc:482] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:52:26.338536 13715 raft_consensus.cc:3037] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:26.342046 13715 raft_consensus.cc:504] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:26.344043 13359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb103755a5864045975a8098938d17cb" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344ed448fc284d628684c27941ffaa7b"
I20260924 12:52:26.344436 13359 raft_consensus.cc:3037] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:26.345342 13715 leader_election.cc:288] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 election: Requested vote from peers 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953), 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295)
I20260924 12:52:26.346506 13502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb103755a5864045975a8098938d17cb" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243efc4817b54d66a47674d9784ae773"
I20260924 12:52:26.346833 13502 raft_consensus.cc:3037] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:26.347909 13359 raft_consensus.cc:2454] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 1.
I20260924 12:52:26.348635 13571 leader_election.cc:302] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344ed448fc284d628684c27941ffaa7b, a04380b45c1a426dbf0faf7ef616fa24; no voters:
I20260924 12:52:26.349180 13715 raft_consensus.cc:2781] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:26.349779 13715 raft_consensus.cc:686] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 1 LEADER]: Becoming Leader. State: Replica: a04380b45c1a426dbf0faf7ef616fa24, State: Running, Role: LEADER
I20260924 12:52:26.350315 13502 raft_consensus.cc:2454] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 1.
I20260924 12:52:26.350173 13715 consensus_queue.cc:237] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:26.354851 13200 catalog_manager.cc:5495] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 reported cstate change: term changed from 0 to 1, leader changed from <none> to a04380b45c1a426dbf0faf7ef616fa24 (127.11.49.67). New cstate: current_term: 1 leader_uuid: "a04380b45c1a426dbf0faf7ef616fa24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } health_report { overall_health: HEALTHY } } }
I20260924 12:52:26.391903 13502 raft_consensus.cc:1261] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Refusing update from remote peer a04380b45c1a426dbf0faf7ef616fa24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:26.391961 13359 raft_consensus.cc:1261] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Refusing update from remote peer a04380b45c1a426dbf0faf7ef616fa24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:26.392939 13747 consensus_queue.cc:1035] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:26.393186 13718 consensus_queue.cc:1035] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260924 12:52:26.423146 13734 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260924 12:52:28.028558 13200 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:28.028894 13200 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:28.033967 13200 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5: Sending DeleteTablet for 3 replicas of tablet cb103755a5864045975a8098938d17cb
I20260924 12:52:28.035068 13338 tablet_service.cc:1514] Processing DeleteTablet for tablet cb103755a5864045975a8098938d17cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:28 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:43268
I20260924 12:52:28.035192 13619 tablet_service.cc:1514] Processing DeleteTablet for tablet cb103755a5864045975a8098938d17cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:28 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:55000
I20260924 12:52:28.035171 13479 tablet_service.cc:1514] Processing DeleteTablet for tablet cb103755a5864045975a8098938d17cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:28 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:47718
I20260924 12:52:28.044968 13780 tablet_replica.cc:330] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b: stopping tablet replica
I20260924 12:52:28.045439 13780 raft_consensus.cc:2229] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:28.045905 13780 raft_consensus.cc:2258] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:28.048240 13780 ts_tablet_manager.cc:1905] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:28.049456 13782 tablet_replica.cc:330] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24: stopping tablet replica
I20260924 12:52:28.049724 13782 raft_consensus.cc:2229] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:52:28.050133 13782 raft_consensus.cc:2258] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:28.051275 13782 ts_tablet_manager.cc:1905] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:28.058550 13781 tablet_replica.cc:330] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773: stopping tablet replica
I20260924 12:52:28.058822 13781 raft_consensus.cc:2229] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:28.059108 13781 raft_consensus.cc:2258] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:28.059194 13782 ts_tablet_manager.cc:1918] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260924 12:52:28.059363 13782 log.cc:1196] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/cb103755a5864045975a8098938d17cb
I20260924 12:52:28.059854 13782 ts_tablet_manager.cc:1939] T cb103755a5864045975a8098938d17cb P a04380b45c1a426dbf0faf7ef616fa24: Deleting consensus metadata
I20260924 12:52:28.060477 13781 ts_tablet_manager.cc:1905] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:28.061228 13188 catalog_manager.cc:4841] TS a04380b45c1a426dbf0faf7ef616fa24 (127.11.49.67:40651): tablet cb103755a5864045975a8098938d17cb (table test-table [id=93e520ce290f467eaca0f7094fa83fb1]) successfully deleted
I20260924 12:52:28.065003 13780 ts_tablet_manager.cc:1918] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260924 12:52:28.065258 13780 log.cc:1196] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/cb103755a5864045975a8098938d17cb
I20260924 12:52:28.065845 13780 ts_tablet_manager.cc:1939] T cb103755a5864045975a8098938d17cb P 344ed448fc284d628684c27941ffaa7b: Deleting consensus metadata
I20260924 12:52:28.067118 13188 catalog_manager.cc:4841] TS 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953): tablet cb103755a5864045975a8098938d17cb (table test-table [id=93e520ce290f467eaca0f7094fa83fb1]) successfully deleted
I20260924 12:52:28.068388 13781 ts_tablet_manager.cc:1918] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260924 12:52:28.068573 13781 log.cc:1196] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/cb103755a5864045975a8098938d17cb
I20260924 12:52:28.069056 13781 ts_tablet_manager.cc:1939] T cb103755a5864045975a8098938d17cb P 243efc4817b54d66a47674d9784ae773: Deleting consensus metadata
I20260924 12:52:28.070457 13188 catalog_manager.cc:4841] TS 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295): tablet cb103755a5864045975a8098938d17cb (table test-table [id=93e520ce290f467eaca0f7094fa83fb1]) successfully deleted
Sep 24 12:52:28 dist-test-slave-m9hg krb5kdc[13157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254348, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 24 12:52:28 dist-test-slave-m9hg krb5kdc[13157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254348, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:28.106518 13790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:28.085797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50510 (local address 127.11.49.126:42701)
0924 12:52:28.086540 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:28.086547 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:28.086676 (+ 129us) server_negotiation.cc:407] Connection header received
0924 12:52:28.086957 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:28.086962 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:28.087036 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:28.087170 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:28.088767 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.089646 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.091031 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.091550 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.091707 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:28.100465 (+ 8758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:28.100472 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:28.100476 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:28.100524 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:28.103399 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:28.104448 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:28.104452 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:28.104455 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:28.104580 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:28.105028 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:28.105033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:28.105035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:28.105333 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:28.105521 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:28.105960 (+ 439us) server_negotiation.cc:299] Negotiation successful
0924 12:52:28.106146 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":366,"threads_started":1}
I20260924 12:52:28.110972 13200 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50510:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:52:28.111613 13200 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:52:28.120460 13338 tablet_service.cc:1467] Processing CreateTablet for tablet aee2e232c26848bea9a8ea73a5fb44c3 (DEFAULT_TABLE table=test-table [id=9807a19c0c884de4aedda7d5110f54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:28.120500 13479 tablet_service.cc:1467] Processing CreateTablet for tablet aee2e232c26848bea9a8ea73a5fb44c3 (DEFAULT_TABLE table=test-table [id=9807a19c0c884de4aedda7d5110f54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:28.120796 13619 tablet_service.cc:1467] Processing CreateTablet for tablet aee2e232c26848bea9a8ea73a5fb44c3 (DEFAULT_TABLE table=test-table [id=9807a19c0c884de4aedda7d5110f54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:28.121044 13479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee2e232c26848bea9a8ea73a5fb44c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:28.121070 13338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee2e232c26848bea9a8ea73a5fb44c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:28.121390 13619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee2e232c26848bea9a8ea73a5fb44c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:28.128165 13791 tablet_bootstrap.cc:492] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24: Bootstrap starting.
I20260924 12:52:28.128991 13793 tablet_bootstrap.cc:492] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b: Bootstrap starting.
I20260924 12:52:28.129464 13792 tablet_bootstrap.cc:492] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773: Bootstrap starting.
I20260924 12:52:28.131096 13793 tablet_bootstrap.cc:654] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:28.131407 13792 tablet_bootstrap.cc:654] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:28.131999 13791 tablet_bootstrap.cc:654] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:28.133961 13793 tablet_bootstrap.cc:492] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b: No bootstrap required, opened a new log
I20260924 12:52:28.134162 13793 ts_tablet_manager.cc:1397] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260924 12:52:28.134083 13792 tablet_bootstrap.cc:492] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773: No bootstrap required, opened a new log
I20260924 12:52:28.134538 13792 ts_tablet_manager.cc:1397] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260924 12:52:28.134708 13791 tablet_bootstrap.cc:492] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24: No bootstrap required, opened a new log
I20260924 12:52:28.134860 13791 ts_tablet_manager.cc:1397] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260924 12:52:28.135160 13793 raft_consensus.cc:348] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.135447 13793 raft_consensus.cc:374] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:28.135551 13793 raft_consensus.cc:729] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344ed448fc284d628684c27941ffaa7b, State: Initialized, Role: FOLLOWER
I20260924 12:52:28.135496 13792 raft_consensus.cc:348] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.135814 13792 raft_consensus.cc:374] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:28.135933 13792 raft_consensus.cc:729] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 243efc4817b54d66a47674d9784ae773, State: Initialized, Role: FOLLOWER
I20260924 12:52:28.135866 13793 consensus_queue.cc:260] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.135808 13791 raft_consensus.cc:348] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.136125 13791 raft_consensus.cc:374] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:28.136237 13791 raft_consensus.cc:729] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04380b45c1a426dbf0faf7ef616fa24, State: Initialized, Role: FOLLOWER
I20260924 12:52:28.136304 13792 consensus_queue.cc:260] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.136633 13791 consensus_queue.cc:260] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.137490 13791 ts_tablet_manager.cc:1428] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 12:52:28.138161 13792 ts_tablet_manager.cc:1428] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 12:52:28.145112 13793 ts_tablet_manager.cc:1428] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b: Time spent starting tablet: real 0.011s user 0.000s sys 0.011s
I20260924 12:52:28.330300 13797 raft_consensus.cc:482] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:52:28.330709 13797 raft_consensus.cc:504] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.332962 13797 leader_election.cc:288] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295), a04380b45c1a426dbf0faf7ef616fa24 (127.11.49.67:40651)
I20260924 12:52:28.342437 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:28.333444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:44533 (local address 127.11.49.66:33295)
0924 12:52:28.335526 (+ 2082us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:28.335533 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:28.335559 (+ 26us) server_negotiation.cc:407] Connection header received
0924 12:52:28.335664 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:28.335670 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:28.335744 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:28.335858 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:28.336597 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.337722 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.340497 (+ 2775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.341337 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.341559 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:28.341647 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:28.341921 (+ 274us) server_negotiation.cc:299] Negotiation successful
0924 12:52:28.342060 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1927,"thread_start_us":1760,"threads_started":1}
I20260924 12:52:28.342489 13799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:28.333284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:33295 (local address 127.11.49.65:44533)
0924 12:52:28.334030 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:28.334058 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:28.334270 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:28.335911 (+ 1641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:28.335915 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:28.335943 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:28.336389 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:28.336397 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.337851 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.337859 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:28.340256 (+ 2397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:28.340294 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.341552 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.341558 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:28.341754 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:28.341780 (+ 26us) client_negotiation.cc:769] Sending connection context
0924 12:52:28.341894 (+ 114us) client_negotiation.cc:240] Negotiation successful
0924 12:52:28.342039 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"mutex_wait_us":11,"thread_start_us":367,"threads_started":1}
I20260924 12:52:28.343186 13503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee2e232c26848bea9a8ea73a5fb44c3" candidate_uuid: "344ed448fc284d628684c27941ffaa7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243efc4817b54d66a47674d9784ae773" is_pre_election: true
I20260924 12:52:28.343465 13503 raft_consensus.cc:2454] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344ed448fc284d628684c27941ffaa7b in term 0.
I20260924 12:52:28.343542 13801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:28.334209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:40651 (local address 127.11.49.65:49875)
0924 12:52:28.334825 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:28.334842 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:28.334947 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:28.335622 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:28.335629 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:28.335666 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:28.336108 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:28.336120 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.338005 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.338014 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:28.340290 (+ 2276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:28.340299 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.342275 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.342283 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:28.342518 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:28.342564 (+ 46us) client_negotiation.cc:769] Sending connection context
0924 12:52:28.342639 (+ 75us) client_negotiation.cc:240] Negotiation successful
0924 12:52:28.342801 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"mutex_wait_us":42,"thread_start_us":310,"threads_started":1}
I20260924 12:52:28.344024 13802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:28.334642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:49875 (local address 127.11.49.67:40651)
0924 12:52:28.335244 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:28.335251 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:28.335280 (+ 29us) server_negotiation.cc:407] Connection header received
0924 12:52:28.335367 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:28.335371 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:28.335433 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:28.335585 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:28.336413 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.337748 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.340492 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.341952 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.343147 (+ 1195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:28.343247 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:28.343305 (+ 58us) server_negotiation.cc:299] Negotiation successful
0924 12:52:28.343524 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":271,"threads_started":1}
I20260924 12:52:28.344076 13291 leader_election.cc:302] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 243efc4817b54d66a47674d9784ae773, 344ed448fc284d628684c27941ffaa7b; no voters:
I20260924 12:52:28.344647 13797 raft_consensus.cc:2781] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:52:28.344791 13797 raft_consensus.cc:482] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:52:28.344892 13797 raft_consensus.cc:3037] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:28.345227 13639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee2e232c26848bea9a8ea73a5fb44c3" candidate_uuid: "344ed448fc284d628684c27941ffaa7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04380b45c1a426dbf0faf7ef616fa24" is_pre_election: true
I20260924 12:52:28.345620 13639 raft_consensus.cc:2454] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344ed448fc284d628684c27941ffaa7b in term 0.
I20260924 12:52:28.348549 13797 raft_consensus.cc:504] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.349380 13797 leader_election.cc:288] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [CANDIDATE]: Term 1 election: Requested vote from peers 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295), a04380b45c1a426dbf0faf7ef616fa24 (127.11.49.67:40651)
I20260924 12:52:28.349910 13639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee2e232c26848bea9a8ea73a5fb44c3" candidate_uuid: "344ed448fc284d628684c27941ffaa7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04380b45c1a426dbf0faf7ef616fa24"
I20260924 12:52:28.349951 13503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee2e232c26848bea9a8ea73a5fb44c3" candidate_uuid: "344ed448fc284d628684c27941ffaa7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243efc4817b54d66a47674d9784ae773"
I20260924 12:52:28.350124 13639 raft_consensus.cc:3037] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:28.350195 13503 raft_consensus.cc:3037] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:28.352510 13639 raft_consensus.cc:2454] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344ed448fc284d628684c27941ffaa7b in term 1.
I20260924 12:52:28.352918 13291 leader_election.cc:302] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344ed448fc284d628684c27941ffaa7b, a04380b45c1a426dbf0faf7ef616fa24; no voters:
I20260924 12:52:28.353284 13797 raft_consensus.cc:2781] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:28.353542 13503 raft_consensus.cc:2454] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344ed448fc284d628684c27941ffaa7b in term 1.
I20260924 12:52:28.354621 13797 raft_consensus.cc:686] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 1 LEADER]: Becoming Leader. State: Replica: 344ed448fc284d628684c27941ffaa7b, State: Running, Role: LEADER
I20260924 12:52:28.355129 13797 consensus_queue.cc:237] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.359118 13200 catalog_manager.cc:5495] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 344ed448fc284d628684c27941ffaa7b (127.11.49.65). New cstate: current_term: 1 leader_uuid: "344ed448fc284d628684c27941ffaa7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } health_report { overall_health: UNKNOWN } } }
I20260924 12:52:28.390568 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:28.383254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46906 (local address 127.11.49.65:39953)
0924 12:52:28.384329 (+ 1075us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:28.384337 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:28.384375 (+ 38us) server_negotiation.cc:407] Connection header received
0924 12:52:28.384514 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:28.384519 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:28.384669 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:28.384910 (+ 241us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:52:28.385424 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.386390 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.387784 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.388341 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.388462 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:28.388920 (+ 458us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:52:28.389741 (+ 821us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:52:28.389869 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:28.390029 (+ 160us) server_negotiation.cc:299] Negotiation successful
0924 12:52:28.390172 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":877,"thread_start_us":711,"threads_started":1}
I20260924 12:52:28.408771 13802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:28.402780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:50823 (local address 127.11.49.67:40651)
0924 12:52:28.403107 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:28.403117 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:28.403443 (+ 326us) server_negotiation.cc:407] Connection header received
0924 12:52:28.403719 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:28.403724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:28.403800 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:28.403917 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:52:28.404559 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.405334 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.406815 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.407250 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.407397 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:28.407900 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:52:28.408037 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:52:28.408142 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:28.408332 (+ 190us) server_negotiation.cc:299] Negotiation successful
0924 12:52:28.408428 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260924 12:52:28.408897 13809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:28.402571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:40651 (local address 127.11.49.65:50823)
0924 12:52:28.403292 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:28.403311 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:28.403549 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:28.403925 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:28.403930 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:28.403941 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 12:52:28.404383 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:28.404394 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.405485 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.405490 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:28.406647 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:28.406659 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.407473 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.407488 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:28.407616 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:28.407692 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 12:52:28.408139 (+ 447us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 12:52:28.408151 (+ 12us) client_negotiation.cc:769] Sending connection context
0924 12:52:28.408320 (+ 169us) client_negotiation.cc:240] Negotiation successful
0924 12:52:28.408500 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":353,"threads_started":1}
I20260924 12:52:28.418690 13503 raft_consensus.cc:1261] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Refusing update from remote peer 344ed448fc284d628684c27941ffaa7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:28.418926 13639 raft_consensus.cc:1261] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Refusing update from remote peer 344ed448fc284d628684c27941ffaa7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:28.419546 13803 consensus_queue.cc:1035] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:28.420043 13797 consensus_queue.cc:1035] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:28.452250 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:28.445315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:38083 (local address 127.11.49.65:39953)
0924 12:52:28.445506 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:28.445511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:28.445819 (+ 308us) server_negotiation.cc:407] Connection header received
0924 12:52:28.446058 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:28.446063 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:28.446150 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:28.446236 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:52:28.446882 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.447758 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.450145 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.450861 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.451014 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:28.451515 (+ 501us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:52:28.451622 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:52:28.451696 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:28.451907 (+ 211us) server_negotiation.cc:299] Negotiation successful
0924 12:52:28.452001 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260924 12:52:28.452539 13813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:28.444915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:39953 (local address 127.11.49.67:38083)
0924 12:52:28.445685 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:28.445712 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:28.445896 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:28.446313 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:28.446317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:28.446329 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 12:52:28.446697 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:28.446706 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.447946 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.447953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:28.449886 (+ 1933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:28.449905 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.451110 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.451116 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:28.451270 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:28.451340 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 12:52:28.451737 (+ 397us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 12:52:28.451747 (+ 10us) client_negotiation.cc:769] Sending connection context
0924 12:52:28.451834 (+ 87us) client_negotiation.cc:240] Negotiation successful
0924 12:52:28.451990 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":602,"threads_started":1}
I20260924 12:52:28.493800 13200 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:28.494138 13200 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:28.498546 13200 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5: Sending DeleteTablet for 3 replicas of tablet aee2e232c26848bea9a8ea73a5fb44c3
I20260924 12:52:28.500046 13338 tablet_service.cc:1514] Processing DeleteTablet for tablet aee2e232c26848bea9a8ea73a5fb44c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:28 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:43268
I20260924 12:52:28.500116 13619 tablet_service.cc:1514] Processing DeleteTablet for tablet aee2e232c26848bea9a8ea73a5fb44c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:28 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:55000
I20260924 12:52:28.500449 13780 tablet_replica.cc:330] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b: stopping tablet replica
I20260924 12:52:28.500840 13780 raft_consensus.cc:2229] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:52:28.500994 13479 tablet_service.cc:1514] Processing DeleteTablet for tablet aee2e232c26848bea9a8ea73a5fb44c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:28 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:47718
I20260924 12:52:28.501363 13781 tablet_replica.cc:330] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773: stopping tablet replica
I20260924 12:52:28.501456 13780 raft_consensus.cc:2258] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:28.501663 13781 raft_consensus.cc:2229] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:28.501816 13782 tablet_replica.cc:330] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24: stopping tablet replica
I20260924 12:52:28.501917 13781 raft_consensus.cc:2258] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:28.502053 13782 raft_consensus.cc:2229] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:28.502272 13782 raft_consensus.cc:2258] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:28.503015 13200 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50510:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 12:52:28.503847 13780 ts_tablet_manager.cc:1905] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:28.503871 13782 ts_tablet_manager.cc:1905] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260924 12:52:28.503957 13200 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:52:28.508622 13781 ts_tablet_manager.cc:1905] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:28.512596 13782 ts_tablet_manager.cc:1918] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:52:28.512581 13780 ts_tablet_manager.cc:1918] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:52:28.512807 13782 log.cc:1196] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/aee2e232c26848bea9a8ea73a5fb44c3
I20260924 12:52:28.512848 13780 log.cc:1196] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/aee2e232c26848bea9a8ea73a5fb44c3
I20260924 12:52:28.513386 13780 ts_tablet_manager.cc:1939] T aee2e232c26848bea9a8ea73a5fb44c3 P 344ed448fc284d628684c27941ffaa7b: Deleting consensus metadata
I20260924 12:52:28.513399 13782 ts_tablet_manager.cc:1939] T aee2e232c26848bea9a8ea73a5fb44c3 P a04380b45c1a426dbf0faf7ef616fa24: Deleting consensus metadata
I20260924 12:52:28.514708 13188 catalog_manager.cc:4841] TS a04380b45c1a426dbf0faf7ef616fa24 (127.11.49.67:40651): tablet aee2e232c26848bea9a8ea73a5fb44c3 (table test-table [id=9807a19c0c884de4aedda7d5110f54b9]) successfully deleted
I20260924 12:52:28.515021 13188 catalog_manager.cc:4841] TS 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953): tablet aee2e232c26848bea9a8ea73a5fb44c3 (table test-table [id=9807a19c0c884de4aedda7d5110f54b9]) successfully deleted
I20260924 12:52:28.518158 13781 ts_tablet_manager.cc:1918] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:52:28.518453 13781 log.cc:1196] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/aee2e232c26848bea9a8ea73a5fb44c3
I20260924 12:52:28.519037 13781 ts_tablet_manager.cc:1939] T aee2e232c26848bea9a8ea73a5fb44c3 P 243efc4817b54d66a47674d9784ae773: Deleting consensus metadata
I20260924 12:52:28.520452 13188 catalog_manager.cc:4841] TS 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295): tablet aee2e232c26848bea9a8ea73a5fb44c3 (table test-table [id=9807a19c0c884de4aedda7d5110f54b9]) successfully deleted
I20260924 12:52:28.522127 13338 tablet_service.cc:1467] Processing CreateTablet for tablet a14703eb7df94ebd8059692187274bd4 (DEFAULT_TABLE table=test-table [id=2424426accd04882aef1d1c1498a5439]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:28.522764 13338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a14703eb7df94ebd8059692187274bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:28.522539 13619 tablet_service.cc:1467] Processing CreateTablet for tablet a14703eb7df94ebd8059692187274bd4 (DEFAULT_TABLE table=test-table [id=2424426accd04882aef1d1c1498a5439]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:28.523165 13619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a14703eb7df94ebd8059692187274bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:28.527915 13479 tablet_service.cc:1467] Processing CreateTablet for tablet a14703eb7df94ebd8059692187274bd4 (DEFAULT_TABLE table=test-table [id=2424426accd04882aef1d1c1498a5439]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:28.528514 13479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a14703eb7df94ebd8059692187274bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:28.531311 13791 tablet_bootstrap.cc:492] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24: Bootstrap starting.
I20260924 12:52:28.533537 13791 tablet_bootstrap.cc:654] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:28.534910 13793 tablet_bootstrap.cc:492] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b: Bootstrap starting.
I20260924 12:52:28.535421 13792 tablet_bootstrap.cc:492] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773: Bootstrap starting.
I20260924 12:52:28.537305 13793 tablet_bootstrap.cc:654] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:28.537453 13792 tablet_bootstrap.cc:654] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:28.537966 13791 tablet_bootstrap.cc:492] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24: No bootstrap required, opened a new log
I20260924 12:52:28.538228 13791 ts_tablet_manager.cc:1397] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260924 12:52:28.539332 13791 raft_consensus.cc:348] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.540817 13791 raft_consensus.cc:374] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:28.540977 13791 raft_consensus.cc:729] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04380b45c1a426dbf0faf7ef616fa24, State: Initialized, Role: FOLLOWER
I20260924 12:52:28.541982 13791 consensus_queue.cc:260] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.544966 13791 ts_tablet_manager.cc:1428] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260924 12:52:28.549998 13793 tablet_bootstrap.cc:492] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b: No bootstrap required, opened a new log
I20260924 12:52:28.550238 13793 ts_tablet_manager.cc:1397] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260924 12:52:28.550326 13792 tablet_bootstrap.cc:492] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773: No bootstrap required, opened a new log
I20260924 12:52:28.550567 13792 ts_tablet_manager.cc:1397] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.000s
I20260924 12:52:28.551038 13793 raft_consensus.cc:348] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.551322 13793 raft_consensus.cc:374] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:28.551411 13793 raft_consensus.cc:729] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344ed448fc284d628684c27941ffaa7b, State: Initialized, Role: FOLLOWER
I20260924 12:52:28.551528 13792 raft_consensus.cc:348] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.551697 13793 consensus_queue.cc:260] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.551858 13792 raft_consensus.cc:374] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:28.551945 13792 raft_consensus.cc:729] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 243efc4817b54d66a47674d9784ae773, State: Initialized, Role: FOLLOWER
I20260924 12:52:28.552382 13793 ts_tablet_manager.cc:1428] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 12:52:28.552610 13792 consensus_queue.cc:260] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.553464 13792 ts_tablet_manager.cc:1428] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260924 12:52:28.690012 13762 raft_consensus.cc:482] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:52:28.690320 13762 raft_consensus.cc:504] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.691089 13762 leader_election.cc:288] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953), 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295)
I20260924 12:52:28.691987 13502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a14703eb7df94ebd8059692187274bd4" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243efc4817b54d66a47674d9784ae773" is_pre_election: true
I20260924 12:52:28.692090 13359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a14703eb7df94ebd8059692187274bd4" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344ed448fc284d628684c27941ffaa7b" is_pre_election: true
I20260924 12:52:28.692276 13502 raft_consensus.cc:2454] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 0.
I20260924 12:52:28.692538 13359 raft_consensus.cc:2454] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 0.
I20260924 12:52:28.692859 13571 leader_election.cc:302] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 243efc4817b54d66a47674d9784ae773, a04380b45c1a426dbf0faf7ef616fa24; no voters:
I20260924 12:52:28.693354 13762 raft_consensus.cc:2781] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:52:28.693492 13762 raft_consensus.cc:482] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:52:28.693604 13762 raft_consensus.cc:3037] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:28.696238 13762 raft_consensus.cc:504] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.697043 13762 leader_election.cc:288] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 election: Requested vote from peers 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953), 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295)
I20260924 12:52:28.697707 13502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a14703eb7df94ebd8059692187274bd4" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243efc4817b54d66a47674d9784ae773"
I20260924 12:52:28.697959 13502 raft_consensus.cc:3037] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:28.697974 13359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a14703eb7df94ebd8059692187274bd4" candidate_uuid: "a04380b45c1a426dbf0faf7ef616fa24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "344ed448fc284d628684c27941ffaa7b"
I20260924 12:52:28.698318 13359 raft_consensus.cc:3037] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:28.700479 13502 raft_consensus.cc:2454] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 1.
I20260924 12:52:28.701007 13571 leader_election.cc:302] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 243efc4817b54d66a47674d9784ae773, a04380b45c1a426dbf0faf7ef616fa24; no voters:
I20260924 12:52:28.701359 13762 raft_consensus.cc:2781] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:28.701534 13762 raft_consensus.cc:686] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 LEADER]: Becoming Leader. State: Replica: a04380b45c1a426dbf0faf7ef616fa24, State: Running, Role: LEADER
I20260924 12:52:28.701866 13762 consensus_queue.cc:237] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } }
I20260924 12:52:28.702011 13359 raft_consensus.cc:2454] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04380b45c1a426dbf0faf7ef616fa24 in term 1.
I20260924 12:52:28.705633 13200 catalog_manager.cc:5495] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 reported cstate change: term changed from 0 to 1, leader changed from <none> to a04380b45c1a426dbf0faf7ef616fa24 (127.11.49.67). New cstate: current_term: 1 leader_uuid: "a04380b45c1a426dbf0faf7ef616fa24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04380b45c1a426dbf0faf7ef616fa24" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40651 } health_report { overall_health: HEALTHY } } }
I20260924 12:52:28.759838 13802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:28.752169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59756 (local address 127.11.49.67:40651)
0924 12:52:28.752388 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:28.752395 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:28.752506 (+ 111us) server_negotiation.cc:407] Connection header received
0924 12:52:28.752932 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:28.752941 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:28.753066 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:28.753183 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:52:28.753953 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.755297 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.757214 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:28.757979 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:28.758229 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:28.758754 (+ 525us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:52:28.758964 (+ 210us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:52:28.759086 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:28.759333 (+ 247us) server_negotiation.cc:299] Negotiation successful
0924 12:52:28.759445 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260924 12:52:28.770831 13502 raft_consensus.cc:1261] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Refusing update from remote peer a04380b45c1a426dbf0faf7ef616fa24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:28.771476 13762 consensus_queue.cc:1035] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "243efc4817b54d66a47674d9784ae773" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:28.771824 13359 raft_consensus.cc:1261] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Refusing update from remote peer a04380b45c1a426dbf0faf7ef616fa24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:28.772491 13762 consensus_queue.cc:1035] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "344ed448fc284d628684c27941ffaa7b" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260924 12:52:28.800496 13760 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260924 12:52:30.404182 13200 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:30.404590 13200 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:30.409741 13200 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fa3bb06de91d4ce98848bc3015c748d5: Sending DeleteTablet for 3 replicas of tablet a14703eb7df94ebd8059692187274bd4
I20260924 12:52:30.410991 13619 tablet_service.cc:1514] Processing DeleteTablet for tablet a14703eb7df94ebd8059692187274bd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:30 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:55000
I20260924 12:52:30.411018 13479 tablet_service.cc:1514] Processing DeleteTablet for tablet a14703eb7df94ebd8059692187274bd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:30 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:47718
I20260924 12:52:30.411232 13338 tablet_service.cc:1514] Processing DeleteTablet for tablet a14703eb7df94ebd8059692187274bd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:30 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:43268
I20260924 12:52:30.411909 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 13273
I20260924 12:52:30.412369 13843 tablet_replica.cc:330] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24: stopping tablet replica
I20260924 12:52:30.412640 13843 raft_consensus.cc:2229] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:52:30.413264 13843 raft_consensus.cc:2258] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:30.415258 13843 ts_tablet_manager.cc:1905] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:30.425343 13843 ts_tablet_manager.cc:1918] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260924 12:52:30.425623 13843 log.cc:1196] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/a14703eb7df94ebd8059692187274bd4
I20260924 12:52:30.426225 13843 ts_tablet_manager.cc:1939] T a14703eb7df94ebd8059692187274bd4 P a04380b45c1a426dbf0faf7ef616fa24: Deleting consensus metadata
I20260924 12:52:30.426676 13845 tablet_replica.cc:330] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b: stopping tablet replica
I20260924 12:52:30.427387 13845 raft_consensus.cc:2229] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:30.427580 13188 catalog_manager.cc:4841] TS a04380b45c1a426dbf0faf7ef616fa24 (127.11.49.67:40651): tablet a14703eb7df94ebd8059692187274bd4 (table test-table [id=2424426accd04882aef1d1c1498a5439]) successfully deleted
I20260924 12:52:30.427855 13845 raft_consensus.cc:2258] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:30.428570 13844 tablet_replica.cc:330] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773: stopping tablet replica
I20260924 12:52:30.428808 13844 raft_consensus.cc:2229] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:30.429064 13844 raft_consensus.cc:2258] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:30.429545 13845 ts_tablet_manager.cc:1905] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:30.430054 13844 ts_tablet_manager.cc:1905] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:30.435135 13844 ts_tablet_manager.cc:1918] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260924 12:52:30.435298 13844 log.cc:1196] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/a14703eb7df94ebd8059692187274bd4
I20260924 12:52:30.435745 13844 ts_tablet_manager.cc:1939] T a14703eb7df94ebd8059692187274bd4 P 243efc4817b54d66a47674d9784ae773: Deleting consensus metadata
Sep 24 12:52:30 dist-test-slave-m9hg krb5kdc[13157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254348, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:52:30.436874 13188 catalog_manager.cc:4841] TS 243efc4817b54d66a47674d9784ae773 (127.11.49.66:33295): tablet a14703eb7df94ebd8059692187274bd4 (table test-table [id=2424426accd04882aef1d1c1498a5439]) successfully deleted
I20260924 12:52:30.437867 13845 ts_tablet_manager.cc:1918] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260924 12:52:30.438040 13845 log.cc:1196] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/a14703eb7df94ebd8059692187274bd4
I20260924 12:52:30.438593 13845 ts_tablet_manager.cc:1939] T a14703eb7df94ebd8059692187274bd4 P 344ed448fc284d628684c27941ffaa7b: Deleting consensus metadata
I20260924 12:52:30.440152 13188 catalog_manager.cc:4841] TS 344ed448fc284d628684c27941ffaa7b (127.11.49.65:39953): tablet a14703eb7df94ebd8059692187274bd4 (table test-table [id=2424426accd04882aef1d1c1498a5439]) successfully deleted
I20260924 12:52:30.444398 13847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:30.413996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46908 (local address 127.11.49.65:39953)
0924 12:52:30.417635 (+ 3639us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:30.417645 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:30.424005 (+ 6360us) server_negotiation.cc:407] Connection header received
0924 12:52:30.424520 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:30.424527 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:30.424675 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:30.424776 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:30.427126 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:30.428337 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:30.430340 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:30.431064 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:30.431191 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:30.437623 (+ 6432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:30.437640 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:30.437656 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:30.437697 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:30.441415 (+ 3718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:30.442327 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:30.442334 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:30.442336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:30.442461 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:30.442821 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:30.442824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:30.442826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:30.443256 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:30.443497 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:30.443827 (+ 330us) server_negotiation.cc:299] Negotiation successful
0924 12:52:30.444012 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3428,"thread_start_us":3270,"threads_started":1}
W20260924 12:52:30.445173 13404 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46908
W20260924 12:52:30.446029 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 13273: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:52:30.446532 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 13273
I20260924 12:52:30.472743 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 13413
Sep 24 12:52:30 dist-test-slave-m9hg krb5kdc[13157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254348, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:52:30.491881 13848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:30.473644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33110 (local address 127.11.49.66:33295)
0924 12:52:30.474293 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:30.474301 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:30.474326 (+ 25us) server_negotiation.cc:407] Connection header received
0924 12:52:30.474403 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:30.474409 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:30.474512 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:30.474621 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:30.476439 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:30.477201 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:30.478694 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:30.479125 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:30.479245 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:30.485065 (+ 5820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:30.485081 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:30.485097 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:30.485143 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:30.488483 (+ 3340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:30.489602 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:30.489609 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:30.489611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:30.489807 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:30.490270 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:30.490274 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:30.490276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:30.490610 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:30.491004 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:30.491223 (+ 219us) server_negotiation.cc:299] Negotiation successful
0924 12:52:30.491421 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":306,"threads_started":1}
W20260924 12:52:30.492810 13544 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33110
W20260924 12:52:30.493757 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 13413: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:52:30.493958 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 13413
I20260924 12:52:30.514093 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 13553
Sep 24 12:52:30 dist-test-slave-m9hg krb5kdc[13157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254348, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:52:30.533635 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:30.515281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59766 (local address 127.11.49.67:40651)
0924 12:52:30.515868 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:30.515874 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:30.515895 (+ 21us) server_negotiation.cc:407] Connection header received
0924 12:52:30.515956 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:30.515960 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:30.516032 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:30.516154 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:30.517952 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:30.518819 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:30.520427 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:30.520931 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:30.521047 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:30.526888 (+ 5841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:30.526905 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:30.526921 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:30.526960 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:30.530203 (+ 3243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:30.531297 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:30.531304 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:30.531307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:30.531510 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:30.531933 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:30.531937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:30.531939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:30.532410 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:30.532663 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:30.533028 (+ 365us) server_negotiation.cc:299] Negotiation successful
0924 12:52:30.533247 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":335,"threads_started":1}
W20260924 12:52:30.534549 13679 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59766
W20260924 12:52:30.535540 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 13553: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:52:30.535827 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 13553
I20260924 12:52:30.566226 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 13170
I20260924 12:52:30.567826 13242 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:30.686980 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 13170
2026-09-24T12:52:30Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9234 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:52:30 dist-test-slave-m9hg krb5kdc[13853](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:52:30 dist-test-slave-m9hg krb5kdc[13853](info): set up 2 sockets
Sep 24 12:52:30 dist-test-slave-m9hg krb5kdc[13853](info): commencing operation
krb5kdc: starting...
W20260924 12:52:31.817298 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.007s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:52:31 dist-test-slave-m9hg krb5kdc[13853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:52:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:52:32.054425 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:33611
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:33611
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:32.471861 13866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:32.472426 13866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:32.472645 13866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:32.481370 13866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:32.481614 13866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:32.481747 13866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:32.481894 13866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:32.481989 13866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:52:32.494050 13866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:33611
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:33611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:32.496019 13866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:32.497884 13866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:32.514019 13871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:32.514184 13874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:32.514112 13872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:32.514967 13866 server_base.cc:1034] running on GCE node
I20260924 12:52:32.516125 13866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:32.518208 13866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:32.519516 13866 hybrid_clock.cc:648] HybridClock initialized: now 1790254352519434 us; error 66 us; skew 500 ppm
I20260924 12:52:32.520067 13866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:32 dist-test-slave-m9hg krb5kdc[13853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254352, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:32.524600 13866 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:52:32.526945 13866 webserver.cc:460] Webserver started at http://127.11.49.126:41183/ using document root <none> and password file <none>
I20260924 12:52:32.527963 13866 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:32.528148 13866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:32.528617 13866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:32.532500 13866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "eceb137356d0405cadb92575c4c221c0"
format_stamp: "Formatted at 2026-09-24 12:52:32 on dist-test-slave-m9hg"
server_key: "cff97bb476037fb269f805f46e14b6c4"
server_key_iv: "0ffc601695f450898341f7e4c061581a"
server_key_version: "encryptionkey@0"
I20260924 12:52:32.533524 13866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "eceb137356d0405cadb92575c4c221c0"
format_stamp: "Formatted at 2026-09-24 12:52:32 on dist-test-slave-m9hg"
server_key: "cff97bb476037fb269f805f46e14b6c4"
server_key_iv: "0ffc601695f450898341f7e4c061581a"
server_key_version: "encryptionkey@0"
I20260924 12:52:32.540753 13866 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260924 12:52:32.545822 13881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:32.548143 13866 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.001s
I20260924 12:52:32.548501 13866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "eceb137356d0405cadb92575c4c221c0"
format_stamp: "Formatted at 2026-09-24 12:52:32 on dist-test-slave-m9hg"
server_key: "cff97bb476037fb269f805f46e14b6c4"
server_key_iv: "0ffc601695f450898341f7e4c061581a"
server_key_version: "encryptionkey@0"
I20260924 12:52:32.548795 13866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:32.573035 13866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:32.578997 13866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:32.579380 13866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:32.605530 13866 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:33611
I20260924 12:52:32.605535 13932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:33611 every 8 connection(s)
I20260924 12:52:32.607613 13866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:32.610148 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 13866
I20260924 12:52:32.610424 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:32.611172 11461 external_mini_cluster.cc:1428] Setting key e5d3519e5c29559843d22fde443e9cee
I20260924 12:52:32.612816 13933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:32.627882 13933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0: Bootstrap starting.
Sep 24 12:52:32 dist-test-slave-m9hg krb5kdc[13853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:32.631466 13933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:32.632756 13933 log.cc:824] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:32.635787 13933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0: No bootstrap required, opened a new log
I20260924 12:52:32.641000 13936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:32.613972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57824 (local address 127.11.49.126:33611)
0924 12:52:32.614996 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:32.615015 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:32.615085 (+ 70us) server_negotiation.cc:407] Connection header received
0924 12:52:32.617014 (+ 1929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:32.617045 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:32.617679 (+ 634us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:32.618214 (+ 535us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:32.620077 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:32.622221 (+ 2144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:32.623907 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:32.625130 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:32.625388 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:32.630512 (+ 5124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:32.630524 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:32.630546 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:32.630611 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:32.634724 (+ 4113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:32.636358 (+ 1634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:32.636368 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:32.636377 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:32.636653 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:32.637164 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:32.637170 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:32.637175 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:32.637931 (+ 756us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:32.638343 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:32.638883 (+ 540us) server_negotiation.cc:299] Negotiation successful
0924 12:52:32.639491 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":719,"thread_start_us":432,"threads_started":1}
I20260924 12:52:32.645005 13933 raft_consensus.cc:348] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eceb137356d0405cadb92575c4c221c0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33611 } }
I20260924 12:52:32.645500 13933 raft_consensus.cc:374] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:32.645618 13933 raft_consensus.cc:729] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eceb137356d0405cadb92575c4c221c0, State: Initialized, Role: FOLLOWER
I20260924 12:52:32.646220 13933 consensus_queue.cc:260] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eceb137356d0405cadb92575c4c221c0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33611 } }
I20260924 12:52:32.646467 13933 raft_consensus.cc:388] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:32.646620 13933 raft_consensus.cc:482] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:32.646806 13933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:32.649052 13933 raft_consensus.cc:504] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eceb137356d0405cadb92575c4c221c0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33611 } }
I20260924 12:52:32.649673 13933 leader_election.cc:302] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eceb137356d0405cadb92575c4c221c0; no voters:
I20260924 12:52:32.650527 13933 leader_election.cc:288] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:32.650884 13938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:32.652340 13938 raft_consensus.cc:686] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [term 1 LEADER]: Becoming Leader. State: Replica: eceb137356d0405cadb92575c4c221c0, State: Running, Role: LEADER
I20260924 12:52:32.653131 13938 consensus_queue.cc:237] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eceb137356d0405cadb92575c4c221c0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33611 } }
I20260924 12:52:32.653708 13933 sys_catalog.cc:564] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:32.657187 13939 sys_catalog.cc:455] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eceb137356d0405cadb92575c4c221c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eceb137356d0405cadb92575c4c221c0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33611 } } }
I20260924 12:52:32.657734 13939 sys_catalog.cc:458] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:32.658098 13940 sys_catalog.cc:455] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eceb137356d0405cadb92575c4c221c0. Latest consensus state: current_term: 1 leader_uuid: "eceb137356d0405cadb92575c4c221c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eceb137356d0405cadb92575c4c221c0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33611 } } }
I20260924 12:52:32.658427 13940 sys_catalog.cc:458] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:32.660598 13947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:32.667758 13947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:32.679059 13947 catalog_manager.cc:1347] Generated new cluster ID: 8d8a99c3d37a4f298dac2e96fe09ea15
I20260924 12:52:32.679250 13947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:32.696902 13947 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:32.699028 13947 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:32.711396 13947 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eceb137356d0405cadb92575c4c221c0: Generated new TSK 0
I20260924 12:52:32.712811 13947 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:52:32.783990 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33611
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:33.217262 13959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:33.217671 13959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:33.217849 13959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:33.226449 13959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:33.226620 13959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:33.226827 13959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:52:33.238691 13959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:33.240724 13959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:33.242492 13959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:33.259989 13964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:33.259994 13965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:33.260067 13967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:33.261289 13959 server_base.cc:1034] running on GCE node
I20260924 12:52:33.262127 13959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:33.263402 13959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:33.264674 13959 hybrid_clock.cc:648] HybridClock initialized: now 1790254353264617 us; error 37 us; skew 500 ppm
I20260924 12:52:33.265151 13959 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:33 dist-test-slave-m9hg krb5kdc[13853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254353, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:33.274652 13959 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:52:33.276965 13959 webserver.cc:460] Webserver started at http://127.11.49.65:46155/ using document root <none> and password file <none>
I20260924 12:52:33.277952 13959 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:33.278115 13959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:33.278539 13959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:33.282784 13959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "03963f1376414e51b8c0d761614c5660"
format_stamp: "Formatted at 2026-09-24 12:52:33 on dist-test-slave-m9hg"
server_key: "b9ef4f2635fd6d5515e2c7def1ec3379"
server_key_iv: "e7611abbe3a300582c5938d2acf4f9fe"
server_key_version: "encryptionkey@0"
I20260924 12:52:33.284381 13959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "03963f1376414e51b8c0d761614c5660"
format_stamp: "Formatted at 2026-09-24 12:52:33 on dist-test-slave-m9hg"
server_key: "b9ef4f2635fd6d5515e2c7def1ec3379"
server_key_iv: "e7611abbe3a300582c5938d2acf4f9fe"
server_key_version: "encryptionkey@0"
I20260924 12:52:33.292449 13959 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260924 12:52:33.297696 13974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:33.300019 13959 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.001s
I20260924 12:52:33.300400 13959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "03963f1376414e51b8c0d761614c5660"
format_stamp: "Formatted at 2026-09-24 12:52:33 on dist-test-slave-m9hg"
server_key: "b9ef4f2635fd6d5515e2c7def1ec3379"
server_key_iv: "e7611abbe3a300582c5938d2acf4f9fe"
server_key_version: "encryptionkey@0"
I20260924 12:52:33.300724 13959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:33.332247 13959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:33.337953 13959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:33.338362 13959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:33.339651 13959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:33.341524 13959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:33.341641 13959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:33.341809 13959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:33.341888 13959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:33.385478 13959 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:43821
I20260924 12:52:33.385536 14086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:43821 every 8 connection(s)
I20260924 12:52:33.387212 13959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:52:33.393850 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 13959
I20260924 12:52:33.394120 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:52:33.395005 11461 external_mini_cluster.cc:1428] Setting key 93c5650c1fd7477f3fc8edf4dbc61953
Sep 24 12:52:33 dist-test-slave-m9hg krb5kdc[13853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254353, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:33.416428 14089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:33.390671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:59519 (local address 127.11.49.126:33611)
0924 12:52:33.391302 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:33.391311 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:33.392674 (+ 1363us) server_negotiation.cc:407] Connection header received
0924 12:52:33.395838 (+ 3164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:33.395847 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:33.395982 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:33.396169 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:33.398382 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:33.399207 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:33.402209 (+ 3002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:33.402726 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:33.402885 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:33.407698 (+ 4813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:33.407709 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:33.407718 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:33.407787 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:33.412006 (+ 4219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:33.413255 (+ 1249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:33.413266 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:33.413273 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:33.413519 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:33.414024 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:33.414033 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:33.414039 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:33.414560 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:33.414761 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:33.415649 (+ 888us) server_negotiation.cc:299] Negotiation successful
0924 12:52:33.415994 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":299,"threads_started":1}
I20260924 12:52:33.417384 14090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:33.391442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:33611 (local address 127.11.49.65:59519)
0924 12:52:33.392447 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:33.392498 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:33.395314 (+ 2816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:33.396535 (+ 1221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:33.396547 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:33.397214 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:33.398130 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:33.398158 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:33.399432 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:33.399442 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:33.401967 (+ 2525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:33.401987 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:33.403036 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:33.403046 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:33.403411 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:33.404457 (+ 1046us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:33.404482 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:33.407271 (+ 2789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:33.412508 (+ 5237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:33.412517 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:33.412532 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:33.413032 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:33.413664 (+ 632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:33.413668 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:33.413670 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:33.413865 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:33.414711 (+ 846us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:33.414718 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:33.415095 (+ 377us) client_negotiation.cc:769] Sending connection context
0924 12:52:33.415418 (+ 323us) client_negotiation.cc:240] Negotiation successful
0924 12:52:33.416004 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":364,"threads_started":1}
I20260924 12:52:33.419888 14087 heartbeater.cc:347] Connected to a master server at 127.11.49.126:33611
I20260924 12:52:33.420315 14087 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:52:33.421216 14087 heartbeater.cc:511] Master 127.11.49.126:33611 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
I20260924 12:52:33.424506 13898 ts_manager.cc:194] Registered new tserver with Master: 03963f1376414e51b8c0d761614c5660 (127.11.49.65:43821)
I20260924 12:52:33.426342 13898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:59519
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:52:33.452896 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33611
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:33.884366 14093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:33.884788 14093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:33.884980 14093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:33.893728 14093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:33.893904 14093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:33.894135 14093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:52:33.905786 14093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:33.907737 14093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:33.909471 14093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:33.926092 14099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:33.926028 14098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:33.926945 14101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:33.927032 14093 server_base.cc:1034] running on GCE node
I20260924 12:52:33.927892 14093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:33.929221 14093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:33.930462 14093 hybrid_clock.cc:648] HybridClock initialized: now 1790254353930426 us; error 56 us; skew 500 ppm
I20260924 12:52:33.930907 14093 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:33 dist-test-slave-m9hg krb5kdc[13853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254353, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:33.934588 14093 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:52:33.936703 14093 webserver.cc:460] Webserver started at http://127.11.49.66:34859/ using document root <none> and password file <none>
I20260924 12:52:33.937505 14093 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:33.937624 14093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:33.938017 14093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:33.941295 14093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "ef0842e2401c44869be08b62a8f22b03"
format_stamp: "Formatted at 2026-09-24 12:52:33 on dist-test-slave-m9hg"
server_key: "473f76b5120ccc4d4d6f8344cc92a870"
server_key_iv: "6cac5443bb72b2f2468f44d40bfea8a2"
server_key_version: "encryptionkey@0"
I20260924 12:52:33.942132 14093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "ef0842e2401c44869be08b62a8f22b03"
format_stamp: "Formatted at 2026-09-24 12:52:33 on dist-test-slave-m9hg"
server_key: "473f76b5120ccc4d4d6f8344cc92a870"
server_key_iv: "6cac5443bb72b2f2468f44d40bfea8a2"
server_key_version: "encryptionkey@0"
I20260924 12:52:33.948107 14093 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260924 12:52:33.952760 14108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:33.955008 14093 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260924 12:52:33.955183 14093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "ef0842e2401c44869be08b62a8f22b03"
format_stamp: "Formatted at 2026-09-24 12:52:33 on dist-test-slave-m9hg"
server_key: "473f76b5120ccc4d4d6f8344cc92a870"
server_key_iv: "6cac5443bb72b2f2468f44d40bfea8a2"
server_key_version: "encryptionkey@0"
I20260924 12:52:33.955407 14093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:33.973206 14093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:33.977708 14093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:33.977968 14093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:33.978971 14093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:33.980500 14093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:33.980587 14093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:33.980676 14093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:33.980724 14093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:34.020545 14093 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:41301
I20260924 12:52:34.020659 14220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:41301 every 8 connection(s)
I20260924 12:52:34.021977 14093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:52:34.030117 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 14093
I20260924 12:52:34.030385 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:52:34.030891 11461 external_mini_cluster.cc:1428] Setting key 6d155c9f3826e6676745a96ee6b8825a
Sep 24 12:52:34 dist-test-slave-m9hg krb5kdc[13853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254353, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:34.049228 14223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:34.025389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:56725 (local address 127.11.49.126:33611)
0924 12:52:34.025902 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:34.025907 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:34.027204 (+ 1297us) server_negotiation.cc:407] Connection header received
0924 12:52:34.029263 (+ 2059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:34.029268 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:34.029371 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:34.029540 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:34.031596 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:34.032652 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:34.034586 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:34.035542 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:34.035766 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:34.041026 (+ 5260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:34.041036 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:34.041042 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:34.041094 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:34.044984 (+ 3890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:34.046113 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:34.046121 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:34.046127 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:34.046287 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:34.046898 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:34.046906 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:34.046911 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:34.047330 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:34.047497 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:34.048448 (+ 951us) server_negotiation.cc:299] Negotiation successful
0924 12:52:34.048727 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":250,"threads_started":1}
I20260924 12:52:34.050500 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:34.026129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:33611 (local address 127.11.49.66:56725)
0924 12:52:34.026998 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:34.027044 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:34.028905 (+ 1861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:34.029854 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:34.029863 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:34.030635 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:34.031345 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:34.031366 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:34.032852 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:34.032857 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:34.034386 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:34.034399 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:34.035834 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:34.035840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:34.036054 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:34.036945 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:34.036977 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:34.040547 (+ 3570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:34.045244 (+ 4697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:34.045256 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:34.045276 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:34.045940 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:34.046486 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:34.046490 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:34.046493 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:34.046748 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:34.047477 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:34.047484 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:34.047944 (+ 460us) client_negotiation.cc:769] Sending connection context
0924 12:52:34.048361 (+ 417us) client_negotiation.cc:240] Negotiation successful
0924 12:52:34.048932 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":318,"threads_started":1}
I20260924 12:52:34.052505 14221 heartbeater.cc:347] Connected to a master server at 127.11.49.126:33611
I20260924 12:52:34.052901 14221 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
I20260924 12:52:34.054024 14221 heartbeater.cc:511] Master 127.11.49.126:33611 requested a full tablet report, sending...
I20260924 12:52:34.056030 13898 ts_manager.cc:194] Registered new tserver with Master: ef0842e2401c44869be08b62a8f22b03 (127.11.49.66:41301)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
I20260924 12:52:34.057379 13898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:56725
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:52:34.084895 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33611
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:52:34.430795 14087 heartbeater.cc:503] Master 127.11.49.126:33611 was elected leader, sending a full tablet report...
W20260924 12:52:34.497382 14227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:34.497776 14227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:34.497979 14227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:34.507088 14227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:34.507272 14227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:34.507622 14227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:52:34.519534 14227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:34.521518 14227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:34.523564 14227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:34.541282 14233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:34.541404 14232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:34.541390 14235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:34.542368 14227 server_base.cc:1034] running on GCE node
I20260924 12:52:34.543208 14227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:34.544592 14227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:34.545830 14227 hybrid_clock.cc:648] HybridClock initialized: now 1790254354545749 us; error 68 us; skew 500 ppm
I20260924 12:52:34.546290 14227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:34 dist-test-slave-m9hg krb5kdc[13853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254354, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:34.550467 14227 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:52:34.552613 14227 webserver.cc:460] Webserver started at http://127.11.49.67:34603/ using document root <none> and password file <none>
I20260924 12:52:34.553601 14227 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:34.553730 14227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:34.554083 14227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:34.558221 14227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "7910a520b3b14056aa0f4331d3196705"
format_stamp: "Formatted at 2026-09-24 12:52:34 on dist-test-slave-m9hg"
server_key: "0888481d1506c73addd5aa76096929c1"
server_key_iv: "82db06708b4b06b9f28eb9a9a4ea9ea3"
server_key_version: "encryptionkey@0"
I20260924 12:52:34.559329 14227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "7910a520b3b14056aa0f4331d3196705"
format_stamp: "Formatted at 2026-09-24 12:52:34 on dist-test-slave-m9hg"
server_key: "0888481d1506c73addd5aa76096929c1"
server_key_iv: "82db06708b4b06b9f28eb9a9a4ea9ea3"
server_key_version: "encryptionkey@0"
I20260924 12:52:34.566777 14227 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260924 12:52:34.571847 14242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:34.573915 14227 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260924 12:52:34.574182 14227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "7910a520b3b14056aa0f4331d3196705"
format_stamp: "Formatted at 2026-09-24 12:52:34 on dist-test-slave-m9hg"
server_key: "0888481d1506c73addd5aa76096929c1"
server_key_iv: "82db06708b4b06b9f28eb9a9a4ea9ea3"
server_key_version: "encryptionkey@0"
I20260924 12:52:34.574446 14227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:34.596175 14227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:34.601964 14227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:34.602360 14227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:34.603601 14227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:34.605723 14227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:34.605840 14227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:34.606014 14227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:34.606097 14227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:34.647274 14227 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:44119
I20260924 12:52:34.647286 14354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:44119 every 8 connection(s)
I20260924 12:52:34.649019 14227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:52:34.650316 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 14227
I20260924 12:52:34.650559 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:52:34.651180 11461 external_mini_cluster.cc:1428] Setting key 22a262373f2ced10f7ff805c234303eb
Sep 24 12:52:34 dist-test-slave-m9hg krb5kdc[13853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254354, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:34.677155 14357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:34.652915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:51159 (local address 127.11.49.126:33611)
0924 12:52:34.656044 (+ 3129us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:34.656053 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:34.656079 (+ 26us) server_negotiation.cc:407] Connection header received
0924 12:52:34.658481 (+ 2402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:34.658488 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:34.658615 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:34.658767 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:34.661236 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:34.662165 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:34.664151 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:34.664730 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:34.664909 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:34.669987 (+ 5078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:34.669992 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:34.669996 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:34.670033 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:34.673278 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:34.674350 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:34.674355 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:34.674358 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:34.674559 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:34.675104 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:34.675109 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:34.675111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:34.675482 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:34.675642 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:34.676570 (+ 928us) server_negotiation.cc:299] Negotiation successful
0924 12:52:34.676807 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2972,"thread_start_us":2790,"threads_started":1}
I20260924 12:52:34.678223 14358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:34.653808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:33611 (local address 127.11.49.67:51159)
0924 12:52:34.655099 (+ 1291us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:34.655175 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:34.658071 (+ 2896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:34.659162 (+ 1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:34.659174 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:34.660016 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:34.660987 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:34.661016 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:34.662372 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:34.662378 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:34.663945 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:34.663963 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:34.665082 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:34.665092 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:34.665398 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:34.666292 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:34.666331 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:34.669706 (+ 3375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:34.673518 (+ 3812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:34.673532 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:34.673548 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:34.674155 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:34.674701 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:34.674705 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:34.674708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:34.674924 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:34.675654 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:34.675661 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:34.676059 (+ 398us) client_negotiation.cc:769] Sending connection context
0924 12:52:34.676450 (+ 391us) client_negotiation.cc:240] Negotiation successful
0924 12:52:34.676915 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":916,"thread_start_us":532,"threads_started":1}
I20260924 12:52:34.680357 14355 heartbeater.cc:347] Connected to a master server at 127.11.49.126:33611
I20260924 12:52:34.680756 14355 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:34.681710 14355 heartbeater.cc:511] Master 127.11.49.126:33611 requested a full tablet report, sending...
I20260924 12:52:34.683465 13898 ts_manager.cc:194] Registered new tserver with Master: 7910a520b3b14056aa0f4331d3196705 (127.11.49.67:44119)
I20260924 12:52:34.684576 13898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:51159
I20260924 12:52:34.696012 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260924 12:52:34.738214 14357 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:52:34.735248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57834 (local address 127.11.49.126:33611)
0924 12:52:34.735537 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:34.735548 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:34.735956 (+ 408us) server_negotiation.cc:407] Connection header received
0924 12:52:34.736227 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:34.736232 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:34.736377 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:34.736493 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:34.737967 (+ 1474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57834: BlockingRecv error: recv got EOF from 127.0.0.1:57834 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260924 12:52:34.741879 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 13959
W20260924 12:52:34.745483 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 13959: Not authorized: Client connection negotiation failed: client connection to 127.11.49.65:43821: server requires authentication, but client does not have Kerberos credentials available
I20260924 12:52:34.745771 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 13959
W20260924 12:52:34.745769 14367 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:52:34.743128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55910 (local address 127.11.49.65:43821)
0924 12:52:34.743838 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:34.743846 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:34.743878 (+ 32us) server_negotiation.cc:407] Connection header received
0924 12:52:34.743944 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:34.743951 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:34.744181 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:34.744435 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:34.745411 (+ 976us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55910: BlockingRecv error: recv got EOF from 127.0.0.1:55910 (error 108)
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":337,"threads_started":1}
I20260924 12:52:34.762816 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14093
W20260924 12:52:34.765983 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14093: Not authorized: Client connection negotiation failed: client connection to 127.11.49.66:41301: server requires authentication, but client does not have Kerberos credentials available
I20260924 12:52:34.766194 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 14093
W20260924 12:52:34.766280 14368 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:52:34.763923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40770 (local address 127.11.49.66:41301)
0924 12:52:34.764507 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:34.764516 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:34.764549 (+ 33us) server_negotiation.cc:407] Connection header received
0924 12:52:34.764619 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:34.764625 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:34.764852 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:34.765006 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:34.765958 (+ 952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40770: BlockingRecv error: recv got EOF from 127.0.0.1:40770 (error 108)
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":347,"threads_started":1}
I20260924 12:52:34.786936 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14227
W20260924 12:52:34.791239 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14227: Not authorized: Client connection negotiation failed: client connection to 127.11.49.67:44119: server requires authentication, but client does not have Kerberos credentials available
I20260924 12:52:34.791400 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 14227
I20260924 12:52:34.810289 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 13866
I20260924 12:52:34.811982 13928 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:34.916703 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 13866
2026-09-24T12:52:34Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4225 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:52:35 dist-test-slave-m9hg krb5kdc[14373](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:52:35 dist-test-slave-m9hg krb5kdc[14373](info): set up 2 sockets
Sep 24 12:52:35 dist-test-slave-m9hg krb5kdc[14373](info): commencing operation
krb5kdc: starting...
W20260924 12:52:36.061666 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.005s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:52:36 dist-test-slave-m9hg krb5kdc[14373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:52:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:52:36.292375 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:41193
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:37401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:41193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:36.668979 14386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:36.669497 14386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:36.669690 14386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:36.678364 14386 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:36.678587 14386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:36.678718 14386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:36.678829 14386 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:36.678926 14386 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:52:36.692329 14386 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:37401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:41193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:41193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:36.694734 14386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:36.697218 14386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:36.712886 14391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:36.713254 14394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:36.713203 14392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:36.714394 14386 server_base.cc:1034] running on GCE node
I20260924 12:52:36.715659 14386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:36.718051 14386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:36.719416 14386 hybrid_clock.cc:648] HybridClock initialized: now 1790254356719323 us; error 83 us; skew 500 ppm
I20260924 12:52:36.720098 14386 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:36 dist-test-slave-m9hg krb5kdc[14373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254356, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:36.724856 14386 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:52:36.727137 14386 webserver.cc:460] Webserver started at http://127.11.49.126:44473/ using document root <none> and password file <none>
I20260924 12:52:36.728164 14386 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:36.728410 14386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:36.728837 14386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:36.732825 14386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "7fe1b6e7a1e34c1ca26585df8a5d88c3"
format_stamp: "Formatted at 2026-09-24 12:52:36 on dist-test-slave-m9hg"
server_key: "2637d1e0088d9df5e111758555c86275"
server_key_iv: "ca92e2bdf73e3f38e0106af5b73a77b1"
server_key_version: "encryptionkey@0"
I20260924 12:52:36.733886 14386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "7fe1b6e7a1e34c1ca26585df8a5d88c3"
format_stamp: "Formatted at 2026-09-24 12:52:36 on dist-test-slave-m9hg"
server_key: "2637d1e0088d9df5e111758555c86275"
server_key_iv: "ca92e2bdf73e3f38e0106af5b73a77b1"
server_key_version: "encryptionkey@0"
I20260924 12:52:36.741253 14386 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260924 12:52:36.746398 14401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:36.748376 14386 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.007s sys 0.000s
I20260924 12:52:36.748701 14386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "7fe1b6e7a1e34c1ca26585df8a5d88c3"
format_stamp: "Formatted at 2026-09-24 12:52:36 on dist-test-slave-m9hg"
server_key: "2637d1e0088d9df5e111758555c86275"
server_key_iv: "ca92e2bdf73e3f38e0106af5b73a77b1"
server_key_version: "encryptionkey@0"
I20260924 12:52:36.748963 14386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:36.770081 14386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:36.775820 14386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:36.776149 14386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:36.804427 14386 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:41193
I20260924 12:52:36.804505 14452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:41193 every 8 connection(s)
I20260924 12:52:36.806406 14386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:36.810509 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 14386
I20260924 12:52:36.810813 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:36.811165 14453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:36.811604 11461 external_mini_cluster.cc:1428] Setting key 0c1dfbca22a7b7dfcb3b5faf7fe2485f
I20260924 12:52:36.826043 14453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3: Bootstrap starting.
I20260924 12:52:36.829584 14453 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3: Neither blocks nor log segments found. Creating new log.
Sep 24 12:52:36 dist-test-slave-m9hg krb5kdc[14373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:36.830781 14453 log.cc:824] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:36.834314 14453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3: No bootstrap required, opened a new log
I20260924 12:52:36.841722 14456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:36.813995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39232 (local address 127.11.49.126:41193)
0924 12:52:36.815253 (+ 1258us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:36.815275 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:36.815732 (+ 457us) server_negotiation.cc:407] Connection header received
0924 12:52:36.818642 (+ 2910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:36.818680 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:36.819378 (+ 698us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:36.819969 (+ 591us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:36.821845 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:36.823409 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:36.825013 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:36.825893 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:36.826154 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:36.831487 (+ 5333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:36.831500 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:36.831524 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:36.831624 (+ 100us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:36.835771 (+ 4147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:36.836892 (+ 1121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:36.836904 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:36.836912 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:36.837154 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:36.837622 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:36.837627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:36.837629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:36.838417 (+ 788us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:36.838886 (+ 469us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:36.839444 (+ 558us) server_negotiation.cc:299] Negotiation successful
0924 12:52:36.840058 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":886,"thread_start_us":542,"threads_started":1}
I20260924 12:52:36.843226 14453 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe1b6e7a1e34c1ca26585df8a5d88c3" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41193 } }
I20260924 12:52:36.843762 14453 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:36.843895 14453 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe1b6e7a1e34c1ca26585df8a5d88c3, State: Initialized, Role: FOLLOWER
I20260924 12:52:36.844607 14453 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe1b6e7a1e34c1ca26585df8a5d88c3" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41193 } }
I20260924 12:52:36.844867 14453 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:36.845036 14453 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:36.845263 14453 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:36.847716 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:52:36.848026 14453 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe1b6e7a1e34c1ca26585df8a5d88c3" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41193 } }
I20260924 12:52:36.848630 14453 leader_election.cc:302] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7fe1b6e7a1e34c1ca26585df8a5d88c3; no voters:
I20260924 12:52:36.849335 14453 leader_election.cc:288] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:36.849624 14458 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:36.851717 14453 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:36.857137 14458 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [term 1 LEADER]: Becoming Leader. State: Replica: 7fe1b6e7a1e34c1ca26585df8a5d88c3, State: Running, Role: LEADER
I20260924 12:52:36.857967 14458 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe1b6e7a1e34c1ca26585df8a5d88c3" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41193 } }
I20260924 12:52:36.866981 14460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7fe1b6e7a1e34c1ca26585df8a5d88c3. Latest consensus state: current_term: 1 leader_uuid: "7fe1b6e7a1e34c1ca26585df8a5d88c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe1b6e7a1e34c1ca26585df8a5d88c3" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41193 } } }
I20260924 12:52:36.867549 14460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:36.867640 14459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7fe1b6e7a1e34c1ca26585df8a5d88c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe1b6e7a1e34c1ca26585df8a5d88c3" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41193 } } }
I20260924 12:52:36.867937 14459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3 [sys.catalog]: This master's current role is: LEADER
W20260924 12:52:36.877637 14474 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 12:52:36.877875 14474 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 12:52:36.879208 14475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:36.881979 14475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:36.893761 14475 catalog_manager.cc:1347] Generated new cluster ID: 6bc777366bb54ffa8fb45d59ce9fd035
I20260924 12:52:36.893896 14475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:36.909186 14456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:36.897557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39234 (local address 127.11.49.126:41193)
0924 12:52:36.897783 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:36.897790 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:36.898532 (+ 742us) server_negotiation.cc:407] Connection header received
0924 12:52:36.898766 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:36.898773 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:36.898867 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:36.898992 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:36.900663 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:36.901818 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:36.903984 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:36.904759 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:36.904907 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:36.907202 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:36.907209 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:36.907214 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:36.908062 (+ 848us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:36.908157 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:36.908190 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:36.908343 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:36.908694 (+ 351us) server_negotiation.cc:299] Negotiation successful
0924 12:52:36.908804 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260924 12:52:36.921204 14475 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:36.923511 14475 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:36.937466 14475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7fe1b6e7a1e34c1ca26585df8a5d88c3: Generated new TSK 0
I20260924 12:52:36.938964 14475 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:52:36.955830 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14386
I20260924 12:52:36.957547 14448 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:37.064765 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 14386
2026-09-24T12:52:37Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2142 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:52:37 dist-test-slave-m9hg krb5kdc[14488](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:52:37 dist-test-slave-m9hg krb5kdc[14488](info): set up 2 sockets
Sep 24 12:52:37 dist-test-slave-m9hg krb5kdc[14488](info): commencing operation
krb5kdc: starting...
W20260924 12:52:38.193287 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.002s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:52:38 dist-test-slave-m9hg krb5kdc[14488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:52:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:52:38.424804 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:41907
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:35167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:41907
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:38.782472 14501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:38.782908 14501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:38.783023 14501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:38.792665 14501 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:38.792865 14501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:38.792917 14501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:38.792982 14501 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:38.793033 14501 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:52:38.807233 14501 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:35167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:41907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:41907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:38.809279 14501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:38.810941 14501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:38.827267 14506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:38.827369 14507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:38.827380 14509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:38.829191 14501 server_base.cc:1034] running on GCE node
I20260924 12:52:38.830121 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:38.831794 14501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:38.833060 14501 hybrid_clock.cc:648] HybridClock initialized: now 1790254358832987 us; error 62 us; skew 500 ppm
I20260924 12:52:38.833484 14501 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:38 dist-test-slave-m9hg krb5kdc[14488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254358, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:38.841202 14501 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:52:38.843302 14501 webserver.cc:460] Webserver started at http://127.11.49.126:33223/ using document root <none> and password file <none>
I20260924 12:52:38.844126 14501 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:38.844341 14501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:38.844689 14501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:38.848001 14501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "e2c57ee4e3764b47a2ef45093d47749b"
format_stamp: "Formatted at 2026-09-24 12:52:38 on dist-test-slave-m9hg"
server_key: "1af3391861d58d5b4aa013aa9b126fea"
server_key_iv: "4e54c785a9c0dcd2b656cf86b04de93c"
server_key_version: "encryptionkey@0"
I20260924 12:52:38.849030 14501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "e2c57ee4e3764b47a2ef45093d47749b"
format_stamp: "Formatted at 2026-09-24 12:52:38 on dist-test-slave-m9hg"
server_key: "1af3391861d58d5b4aa013aa9b126fea"
server_key_iv: "4e54c785a9c0dcd2b656cf86b04de93c"
server_key_version: "encryptionkey@0"
I20260924 12:52:38.855475 14501 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260924 12:52:38.860216 14516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:38.862195 14501 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:52:38.862453 14501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "e2c57ee4e3764b47a2ef45093d47749b"
format_stamp: "Formatted at 2026-09-24 12:52:38 on dist-test-slave-m9hg"
server_key: "1af3391861d58d5b4aa013aa9b126fea"
server_key_iv: "4e54c785a9c0dcd2b656cf86b04de93c"
server_key_version: "encryptionkey@0"
I20260924 12:52:38.862686 14501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:38.883074 14501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:38.888525 14501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:38.888872 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:38.911223 14501 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:41907
I20260924 12:52:38.911338 14567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:41907 every 8 connection(s)
I20260924 12:52:38.912760 14501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:38.918207 14568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:38.921218 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 14501
I20260924 12:52:38.921485 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:38.922371 11461 external_mini_cluster.cc:1428] Setting key 30d913324bffa771608a3980b13845c0
I20260924 12:52:38.934407 14568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b: Bootstrap starting.
I20260924 12:52:38.939642 14568 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b: Neither blocks nor log segments found. Creating new log.
Sep 24 12:52:38 dist-test-slave-m9hg krb5kdc[14488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:38.941363 14568 log.cc:824] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:38.946691 14568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b: No bootstrap required, opened a new log
I20260924 12:52:38.950742 14571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:38.925421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55860 (local address 127.11.49.126:41907)
0924 12:52:38.926579 (+ 1158us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:38.926595 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:38.926649 (+ 54us) server_negotiation.cc:407] Connection header received
0924 12:52:38.928802 (+ 2153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:38.928833 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:38.929390 (+ 557us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:38.930032 (+ 642us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:38.931764 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:38.933410 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:38.934924 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:38.935815 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:38.936057 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:38.941065 (+ 5008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:38.941075 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:38.941094 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:38.941148 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:38.945753 (+ 4605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:38.946677 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:38.946685 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:38.946693 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:38.947000 (+ 307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:38.947435 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:38.947441 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:38.947444 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:38.948125 (+ 681us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:38.948557 (+ 432us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:38.949012 (+ 455us) server_negotiation.cc:299] Negotiation successful
0924 12:52:38.949547 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":865,"thread_start_us":509,"threads_started":1}
I20260924 12:52:38.958580 14568 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2c57ee4e3764b47a2ef45093d47749b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41907 } }
I20260924 12:52:38.959161 14568 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:38.959286 14568 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2c57ee4e3764b47a2ef45093d47749b, State: Initialized, Role: FOLLOWER
I20260924 12:52:38.960080 14568 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2c57ee4e3764b47a2ef45093d47749b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41907 } }
I20260924 12:52:38.960412 14568 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:38.960590 14568 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:38.960825 14568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:38.964378 14568 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2c57ee4e3764b47a2ef45093d47749b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41907 } }
I20260924 12:52:38.965284 14568 leader_election.cc:302] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2c57ee4e3764b47a2ef45093d47749b; no voters:
I20260924 12:52:38.966162 14568 leader_election.cc:288] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:38.966463 14573 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:38.967968 14573 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [term 1 LEADER]: Becoming Leader. State: Replica: e2c57ee4e3764b47a2ef45093d47749b, State: Running, Role: LEADER
I20260924 12:52:38.968734 14573 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2c57ee4e3764b47a2ef45093d47749b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41907 } }
I20260924 12:52:38.969348 14568 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:38.971853 14575 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2c57ee4e3764b47a2ef45093d47749b. Latest consensus state: current_term: 1 leader_uuid: "e2c57ee4e3764b47a2ef45093d47749b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2c57ee4e3764b47a2ef45093d47749b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41907 } } }
I20260924 12:52:38.972343 14575 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:38.974936 14574 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2c57ee4e3764b47a2ef45093d47749b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2c57ee4e3764b47a2ef45093d47749b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41907 } } }
I20260924 12:52:38.976835 14574 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:38.979606 14578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:38.985638 14578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:38.999490 14578 catalog_manager.cc:1347] Generated new cluster ID: adb3c1e644d0493cb8fc8e2b6f703591
I20260924 12:52:38.999652 14578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:39.016359 14578 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:39.018291 14578 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:39.030437 14578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2c57ee4e3764b47a2ef45093d47749b: Generated new TSK 0
I20260924 12:52:39.031744 14578 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:52:39.106165 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41907
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:35167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:39.552798 14595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:39.553301 14595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:39.553498 14595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:39.562240 14595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:39.562497 14595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:39.562726 14595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:52:39.575371 14595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:35167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:39.577293 14595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:39.579072 14595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:39.599560 14600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:39.599671 14601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:39.599689 14603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:39.600536 14595 server_base.cc:1034] running on GCE node
I20260924 12:52:39.601321 14595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:39.602538 14595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:39.603820 14595 hybrid_clock.cc:648] HybridClock initialized: now 1790254359603731 us; error 78 us; skew 500 ppm
I20260924 12:52:39.604197 14595 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:39 dist-test-slave-m9hg krb5kdc[14488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254359, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:39.607892 14595 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:52:39.609748 14595 webserver.cc:460] Webserver started at http://127.11.49.65:46117/ using document root <none> and password file <none>
I20260924 12:52:39.610536 14595 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:39.610700 14595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:39.611037 14595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:39.614223 14595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "fc8d5401c06940fb81debabb244a9abc"
format_stamp: "Formatted at 2026-09-24 12:52:39 on dist-test-slave-m9hg"
server_key: "103d3412cc6586ccc76568a97a016373"
server_key_iv: "f418cb2d4e1d8209fabb13dce50f2ca2"
server_key_version: "encryptionkey@0"
I20260924 12:52:39.615090 14595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "fc8d5401c06940fb81debabb244a9abc"
format_stamp: "Formatted at 2026-09-24 12:52:39 on dist-test-slave-m9hg"
server_key: "103d3412cc6586ccc76568a97a016373"
server_key_iv: "f418cb2d4e1d8209fabb13dce50f2ca2"
server_key_version: "encryptionkey@0"
I20260924 12:52:39.621464 14595 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260924 12:52:39.626499 14610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:39.628578 14595 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260924 12:52:39.628855 14595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "fc8d5401c06940fb81debabb244a9abc"
format_stamp: "Formatted at 2026-09-24 12:52:39 on dist-test-slave-m9hg"
server_key: "103d3412cc6586ccc76568a97a016373"
server_key_iv: "f418cb2d4e1d8209fabb13dce50f2ca2"
server_key_version: "encryptionkey@0"
I20260924 12:52:39.629142 14595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:39.649695 14595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:39.654649 14595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:39.654965 14595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:39.656155 14595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:39.657785 14595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:39.657897 14595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:39.658066 14595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:39.658149 14595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:39.700045 14595 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:43367
I20260924 12:52:39.700138 14722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:43367 every 8 connection(s)
I20260924 12:52:39.702030 14595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:52:39.705667 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 14595
I20260924 12:52:39.705989 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:52:39.706705 11461 external_mini_cluster.cc:1428] Setting key 3a171e38e64face6ed4f4283502b4959
Sep 24 12:52:39 dist-test-slave-m9hg krb5kdc[14488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254359, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:39.729442 14725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:39.705345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:54135 (local address 127.11.49.126:41907)
0924 12:52:39.705967 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:39.705981 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:39.707411 (+ 1430us) server_negotiation.cc:407] Connection header received
0924 12:52:39.709747 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:39.709756 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:39.709846 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:39.709992 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:39.712056 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:39.713252 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:39.716626 (+ 3374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:39.717059 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:39.717217 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:39.723319 (+ 6102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:39.723325 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:39.723329 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:39.723367 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:39.726135 (+ 2768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:39.726997 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:39.727010 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:39.727013 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:39.727129 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:39.727573 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:39.727578 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:39.727581 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:39.727856 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:39.728010 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:39.728843 (+ 833us) server_negotiation.cc:299] Negotiation successful
0924 12:52:39.729073 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":287,"threads_started":1}
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:52:39.730527 14726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:39.706119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:41907 (local address 127.11.49.65:54135)
0924 12:52:39.707170 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:39.707232 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:39.709390 (+ 2158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:39.710273 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:39.710283 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:39.710992 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:39.711808 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:39.711833 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:39.713526 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:39.713532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:39.716251 (+ 2719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:39.716341 (+ 90us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:39.717464 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:39.717477 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:39.717968 (+ 491us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:39.719131 (+ 1163us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:39.719190 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:39.723004 (+ 3814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:39.726319 (+ 3315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:39.726330 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:39.726349 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:39.726858 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:39.727252 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:39.727257 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:39.727260 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:39.727454 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:39.727988 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:39.727996 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:39.728453 (+ 457us) client_negotiation.cc:769] Sending connection context
0924 12:52:39.728729 (+ 276us) client_negotiation.cc:240] Negotiation successful
0924 12:52:39.729311 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":447,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
I20260924 12:52:39.732920 14723 heartbeater.cc:347] Connected to a master server at 127.11.49.126:41907
I20260924 12:52:39.733384 14723 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:39.734516 14723 heartbeater.cc:511] Master 127.11.49.126:41907 requested a full tablet report, sending...
I20260924 12:52:39.737571 14533 ts_manager.cc:194] Registered new tserver with Master: fc8d5401c06940fb81debabb244a9abc (127.11.49.65:43367)
I20260924 12:52:39.739987 14533 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:54135
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:52:39.764096 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41907
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:35167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:40.189778 14729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:40.190189 14729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:40.190526 14729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:40.199657 14729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:40.199843 14729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:40.200049 14729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:52:40.212335 14729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:35167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:40.214238 14729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:40.216024 14729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:40.233736 14737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:40.233740 14735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:40.234077 14734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:40.235172 14729 server_base.cc:1034] running on GCE node
I20260924 12:52:40.235987 14729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:40.237387 14729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:40.238652 14729 hybrid_clock.cc:648] HybridClock initialized: now 1790254360238596 us; error 51 us; skew 500 ppm
I20260924 12:52:40.239115 14729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:40 dist-test-slave-m9hg krb5kdc[14488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254360, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:40.243448 14729 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:52:40.245818 14729 webserver.cc:460] Webserver started at http://127.11.49.66:42877/ using document root <none> and password file <none>
I20260924 12:52:40.246863 14729 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:40.247048 14729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:40.247475 14729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:40.251566 14729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "f583a1ae1471451c8f1ad209701c2b30"
format_stamp: "Formatted at 2026-09-24 12:52:40 on dist-test-slave-m9hg"
server_key: "a626667ea763aaf57e66bf819f2119dd"
server_key_iv: "8af21ab9f13e601e5395b210cfd8edef"
server_key_version: "encryptionkey@0"
I20260924 12:52:40.252748 14729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "f583a1ae1471451c8f1ad209701c2b30"
format_stamp: "Formatted at 2026-09-24 12:52:40 on dist-test-slave-m9hg"
server_key: "a626667ea763aaf57e66bf819f2119dd"
server_key_iv: "8af21ab9f13e601e5395b210cfd8edef"
server_key_version: "encryptionkey@0"
I20260924 12:52:40.259939 14729 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.005s
I20260924 12:52:40.264985 14744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:40.267287 14729 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:52:40.267613 14729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "f583a1ae1471451c8f1ad209701c2b30"
format_stamp: "Formatted at 2026-09-24 12:52:40 on dist-test-slave-m9hg"
server_key: "a626667ea763aaf57e66bf819f2119dd"
server_key_iv: "8af21ab9f13e601e5395b210cfd8edef"
server_key_version: "encryptionkey@0"
I20260924 12:52:40.267928 14729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:40.288412 14729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:40.294099 14729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:40.294447 14729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:40.295679 14729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:40.297410 14729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:40.297501 14729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:40.297610 14729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:40.297658 14729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:40.340337 14729 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:44745
I20260924 12:52:40.340341 14856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:44745 every 8 connection(s)
I20260924 12:52:40.342118 14729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:52:40.351128 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 14729
I20260924 12:52:40.351331 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:52:40.351838 11461 external_mini_cluster.cc:1428] Setting key 8c0c4c548d4980df544c95abb50b33f7
Sep 24 12:52:40 dist-test-slave-m9hg krb5kdc[14488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254360, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:40.369915 14859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:40.345547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:34107 (local address 127.11.49.126:41907)
0924 12:52:40.346039 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:40.346044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:40.347404 (+ 1360us) server_negotiation.cc:407] Connection header received
0924 12:52:40.349498 (+ 2094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:40.349503 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:40.349598 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:40.349720 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:40.351809 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:40.352987 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:40.355213 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:40.355742 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:40.355880 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:40.361222 (+ 5342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:40.361232 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:40.361239 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:40.361295 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:40.365196 (+ 3901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:40.366442 (+ 1246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:40.366451 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:40.366458 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:40.366654 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:40.367348 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:40.367356 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:40.367362 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:40.367779 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:40.367971 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:40.369143 (+ 1172us) server_negotiation.cc:299] Negotiation successful
0924 12:52:40.369432 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":287,"threads_started":1}
I20260924 12:52:40.371389 14860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:40.346203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:41907 (local address 127.11.49.66:34107)
0924 12:52:40.347204 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:40.347253 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:40.349200 (+ 1947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:40.349981 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:40.349990 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:40.350573 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:40.351519 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:40.351545 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:40.353196 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:40.353200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:40.354992 (+ 1792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:40.355012 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:40.356036 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:40.356046 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:40.356438 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:40.357360 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:40.357397 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:40.360880 (+ 3483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:40.365481 (+ 4601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:40.365493 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:40.365514 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:40.366268 (+ 754us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:40.366839 (+ 571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:40.366844 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:40.366846 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:40.367192 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:40.368014 (+ 822us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:40.368031 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:40.368634 (+ 603us) client_negotiation.cc:769] Sending connection context
0924 12:52:40.369001 (+ 367us) client_negotiation.cc:240] Negotiation successful
0924 12:52:40.369711 (+ 710us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":424,"threads_started":1}
I20260924 12:52:40.373812 14857 heartbeater.cc:347] Connected to a master server at 127.11.49.126:41907
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
I20260924 12:52:40.374369 14857 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:40.375504 14857 heartbeater.cc:511] Master 127.11.49.126:41907 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
I20260924 12:52:40.377847 14533 ts_manager.cc:194] Registered new tserver with Master: f583a1ae1471451c8f1ad209701c2b30 (127.11.49.66:44745)
I20260924 12:52:40.378875 14533 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:34107
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:52:40.404789 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41907
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:35167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:52:40.744311 14723 heartbeater.cc:503] Master 127.11.49.126:41907 was elected leader, sending a full tablet report...
W20260924 12:52:40.761350 14863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:40.761755 14863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:40.761865 14863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:40.771437 14863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:40.771621 14863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:40.771757 14863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:52:40.784204 14863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:35167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:40.786269 14863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:40.788209 14863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:40.805780 14868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:40.806675 14869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:40.806648 14871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:40.807682 14863 server_base.cc:1034] running on GCE node
I20260924 12:52:40.808597 14863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:40.810089 14863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:40.811699 14863 hybrid_clock.cc:648] HybridClock initialized: now 1790254360811591 us; error 107 us; skew 500 ppm
I20260924 12:52:40.812172 14863 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:40 dist-test-slave-m9hg krb5kdc[14488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254360, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:40.816148 14863 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:52:40.818221 14863 webserver.cc:460] Webserver started at http://127.11.49.67:45647/ using document root <none> and password file <none>
I20260924 12:52:40.819031 14863 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:40.819187 14863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:40.819517 14863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:40.822674 14863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "aca20348ee184ba8921c16aa1dd036ce"
format_stamp: "Formatted at 2026-09-24 12:52:40 on dist-test-slave-m9hg"
server_key: "54e5a44d47dd72282c1514fb6c4ea664"
server_key_iv: "f709d1c29b29900bbe3ef4851feb6fe3"
server_key_version: "encryptionkey@0"
I20260924 12:52:40.823510 14863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "aca20348ee184ba8921c16aa1dd036ce"
format_stamp: "Formatted at 2026-09-24 12:52:40 on dist-test-slave-m9hg"
server_key: "54e5a44d47dd72282c1514fb6c4ea664"
server_key_iv: "f709d1c29b29900bbe3ef4851feb6fe3"
server_key_version: "encryptionkey@0"
I20260924 12:52:40.829770 14863 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260924 12:52:40.834206 14878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:40.836081 14863 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:52:40.836371 14863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "aca20348ee184ba8921c16aa1dd036ce"
format_stamp: "Formatted at 2026-09-24 12:52:40 on dist-test-slave-m9hg"
server_key: "54e5a44d47dd72282c1514fb6c4ea664"
server_key_iv: "f709d1c29b29900bbe3ef4851feb6fe3"
server_key_version: "encryptionkey@0"
I20260924 12:52:40.836593 14863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:40.857101 14863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:40.861891 14863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:40.862205 14863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:40.863379 14863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:40.865037 14863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:40.865154 14863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:40.865315 14863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:40.865388 14863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:40.906098 14863 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:45377
I20260924 12:52:40.906265 14990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:45377 every 8 connection(s)
I20260924 12:52:40.907562 14863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:52:40.909256 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 14863
I20260924 12:52:40.909478 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:52:40.909965 11461 external_mini_cluster.cc:1428] Setting key 7ecf8e676df75802063f3ed146648c4e
Sep 24 12:52:40 dist-test-slave-m9hg krb5kdc[14488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254360, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:40.938530 14994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:40.911957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:34669 (local address 127.11.49.126:41907)
0924 12:52:40.920725 (+ 8768us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:40.920732 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:40.920752 (+ 20us) server_negotiation.cc:407] Connection header received
0924 12:52:40.920801 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:40.920805 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:40.920865 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:40.921034 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:40.922625 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:40.923495 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:40.925376 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:40.926347 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:40.926531 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:40.930767 (+ 4236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:40.930773 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:40.930777 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:40.930824 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:40.934582 (+ 3758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:40.935632 (+ 1050us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:40.935637 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:40.935640 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:40.935834 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:40.936462 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:40.936466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:40.936468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:40.936792 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:40.936969 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:40.937851 (+ 882us) server_negotiation.cc:299] Negotiation successful
0924 12:52:40.938115 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8637,"thread_start_us":8491,"threads_started":1}
I20260924 12:52:40.939517 14993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:40.911782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:41907 (local address 127.11.49.67:34669)
0924 12:52:40.916962 (+ 5180us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:40.917013 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:40.918681 (+ 1668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:40.921304 (+ 2623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:40.921314 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:40.921869 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:40.922440 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:40.922457 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:40.923664 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:40.923668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:40.925103 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:40.925122 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:40.926666 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:40.926673 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:40.927081 (+ 408us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:40.927854 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:40.927901 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:40.930490 (+ 2589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:40.934871 (+ 4381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:40.934880 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:40.934895 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:40.935433 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:40.935982 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:40.935986 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:40.935988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:40.936216 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:40.936937 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:40.936946 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:40.937411 (+ 465us) client_negotiation.cc:769] Sending connection context
0924 12:52:40.937741 (+ 330us) client_negotiation.cc:240] Negotiation successful
0924 12:52:40.938194 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4856,"thread_start_us":4603,"threads_started":1}
I20260924 12:52:40.941893 14991 heartbeater.cc:347] Connected to a master server at 127.11.49.126:41907
I20260924 12:52:40.942266 14991 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:40.943099 14991 heartbeater.cc:511] Master 127.11.49.126:41907 requested a full tablet report, sending...
I20260924 12:52:40.945013 14532 ts_manager.cc:194] Registered new tserver with Master: aca20348ee184ba8921c16aa1dd036ce (127.11.49.67:45377)
I20260924 12:52:40.946012 14532 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:34669
I20260924 12:52:40.954768 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 24 12:52:40 dist-test-slave-m9hg krb5kdc[14488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254360, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Sep 24 12:52:41 dist-test-slave-m9hg krb5kdc[14488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254360, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:41.013418 14994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:40.996330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55864 (local address 127.11.49.126:41907)
0924 12:52:40.996612 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:40.996624 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:40.997227 (+ 603us) server_negotiation.cc:407] Connection header received
0924 12:52:40.997411 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:40.997416 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:40.997518 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:40.997639 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:40.999285 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:41.000217 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:41.001598 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:41.001998 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:41.002150 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:41.006524 (+ 4374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:41.006531 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:41.006536 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:41.006596 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:41.010168 (+ 3572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:41.011053 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:41.011058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:41.011061 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:41.011242 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:41.011756 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:41.011759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:41.011761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:41.012165 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:41.012534 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:41.012858 (+ 324us) server_negotiation.cc:299] Negotiation successful
0924 12:52:41.013102 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260924 12:52:41.014165 14532 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:55864
I20260924 12:52:41.016255 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14595
Sep 24 12:52:41 dist-test-slave-m9hg krb5kdc[14488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254360, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:52:41.036610 15003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:41.017732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33448 (local address 127.11.49.65:43367)
0924 12:52:41.018492 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:41.018500 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:41.018530 (+ 30us) server_negotiation.cc:407] Connection header received
0924 12:52:41.018601 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:41.018608 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:41.018858 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:41.019022 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:41.020573 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:41.021698 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:41.023294 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:41.023987 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:41.024129 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:41.029398 (+ 5269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:41.029415 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:41.029431 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:41.029475 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:41.032938 (+ 3463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:41.034081 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:41.034089 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:41.034092 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:41.034297 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:41.034800 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:41.034803 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:41.034805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:41.035229 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:41.035480 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:41.035962 (+ 482us) server_negotiation.cc:299] Negotiation successful
0924 12:52:41.036196 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":394,"threads_started":1}
W20260924 12:52:41.038193 14718 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:33448
W20260924 12:52:41.039803 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14595: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:52:41.040109 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 14595
I20260924 12:52:41.059820 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14729
Sep 24 12:52:41 dist-test-slave-m9hg krb5kdc[14488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254360, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:52:41.080749 15004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:41.061084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39266 (local address 127.11.49.66:44745)
0924 12:52:41.061745 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:41.061755 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:41.061788 (+ 33us) server_negotiation.cc:407] Connection header received
0924 12:52:41.061875 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:41.061883 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:41.062206 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:41.062399 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:41.063740 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:41.065276 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:41.066808 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:41.067606 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:41.067755 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:41.073096 (+ 5341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:41.073119 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:41.073140 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:41.073201 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:41.077150 (+ 3949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:41.078058 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:41.078066 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:41.078069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:41.078254 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:41.078680 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:41.078684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:41.078686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:41.079310 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:41.079623 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:41.080015 (+ 392us) server_negotiation.cc:299] Negotiation successful
0924 12:52:41.080389 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":334,"threads_started":1}
W20260924 12:52:41.082211 14852 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:39266
W20260924 12:52:41.083424 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14729: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:52:41.083570 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 14729
I20260924 12:52:41.101500 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14863
Sep 24 12:52:41 dist-test-slave-m9hg krb5kdc[14488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254360, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:52:41.121891 15005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:41.102742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49438 (local address 127.11.49.67:45377)
0924 12:52:41.103531 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:41.103537 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:41.103572 (+ 35us) server_negotiation.cc:407] Connection header received
0924 12:52:41.103650 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:41.103656 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:41.103865 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:41.104031 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:41.106082 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:41.107204 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:41.109294 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:41.109978 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:41.110122 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:41.115523 (+ 5401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:41.115536 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:41.115551 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:41.115610 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:41.118632 (+ 3022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:41.119580 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:41.119588 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:41.119590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:41.119737 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:41.120126 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:41.120129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:41.120131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:41.120659 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:41.120915 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:41.121330 (+ 415us) server_negotiation.cc:299] Negotiation successful
0924 12:52:41.121565 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":452,"threads_started":1}
W20260924 12:52:41.123235 14986 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49438
W20260924 12:52:41.124539 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14863: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:52:41.124742 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 14863
I20260924 12:52:41.142931 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 14501
I20260924 12:52:41.144397 14563 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:41.252619 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 14501
2026-09-24T12:52:41Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4190 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:52:41 dist-test-slave-m9hg krb5kdc[15009](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:52:41 dist-test-slave-m9hg krb5kdc[15009](info): set up 2 sockets
Sep 24 12:52:41 dist-test-slave-m9hg krb5kdc[15009](info): commencing operation
krb5kdc: starting...
W20260924 12:52:42.397567 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:52:42 dist-test-slave-m9hg krb5kdc[15009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:52:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:52:42.647598 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42107
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:42107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:43.081995 15022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:43.082459 15022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:43.082655 15022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:43.092672 15022 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:43.092859 15022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:43.092911 15022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:43.093024 15022 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:43.093103 15022 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:52:43.107156 15022 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:42107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:43.109529 15022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:43.111523 15022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:43.127749 15028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:43.127867 15027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:43.127858 15030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:43.128830 15022 server_base.cc:1034] running on GCE node
I20260924 12:52:43.129904 15022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:43.131983 15022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:43.133301 15022 hybrid_clock.cc:648] HybridClock initialized: now 1790254363133247 us; error 82 us; skew 500 ppm
I20260924 12:52:43.133994 15022 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:43 dist-test-slave-m9hg krb5kdc[15009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254363, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:43.139578 15022 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:52:43.142009 15022 webserver.cc:460] Webserver started at http://127.11.49.126:34467/ using document root <none> and password file <none>
I20260924 12:52:43.142997 15022 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:43.143134 15022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:43.143739 15022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:43.148707 15022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "65516dd6dae64e55be6ab3757ec58801"
format_stamp: "Formatted at 2026-09-24 12:52:43 on dist-test-slave-m9hg"
server_key: "a88840fb2409f21284b35210901a1514"
server_key_iv: "84347427229b11c114c698d3b5f3101d"
server_key_version: "encryptionkey@0"
I20260924 12:52:43.149931 15022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "65516dd6dae64e55be6ab3757ec58801"
format_stamp: "Formatted at 2026-09-24 12:52:43 on dist-test-slave-m9hg"
server_key: "a88840fb2409f21284b35210901a1514"
server_key_iv: "84347427229b11c114c698d3b5f3101d"
server_key_version: "encryptionkey@0"
I20260924 12:52:43.157720 15022 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260924 12:52:43.163067 15037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:43.166080 15022 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260924 12:52:43.166517 15022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "65516dd6dae64e55be6ab3757ec58801"
format_stamp: "Formatted at 2026-09-24 12:52:43 on dist-test-slave-m9hg"
server_key: "a88840fb2409f21284b35210901a1514"
server_key_iv: "84347427229b11c114c698d3b5f3101d"
server_key_version: "encryptionkey@0"
I20260924 12:52:43.166838 15022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:43.187229 15022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:43.193166 15022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:43.193575 15022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:43.217900 15022 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:42107
I20260924 12:52:43.217935 15088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:42107 every 8 connection(s)
I20260924 12:52:43.219810 15022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:43.224437 15089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:43.226874 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 15022
I20260924 12:52:43.227216 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:43.227945 11461 external_mini_cluster.cc:1428] Setting key 82a26ad10e23d838ae99783aba303f3e
I20260924 12:52:43.239786 15089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801: Bootstrap starting.
I20260924 12:52:43.243947 15089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:43.245393 15089 log.cc:824] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801: Log is configured to *not* fsync() on all Append() calls
Sep 24 12:52:43 dist-test-slave-m9hg krb5kdc[15009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:43.249109 15089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801: No bootstrap required, opened a new log
I20260924 12:52:43.258219 15089 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65516dd6dae64e55be6ab3757ec58801" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42107 } }
I20260924 12:52:43.258687 15089 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:43.258857 15089 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65516dd6dae64e55be6ab3757ec58801, State: Initialized, Role: FOLLOWER
I20260924 12:52:43.259531 15089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65516dd6dae64e55be6ab3757ec58801" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42107 } }
I20260924 12:52:43.259776 15089 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:43.259965 15089 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:43.260180 15089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:43.260336 15092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:43.231191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54778 (local address 127.11.49.126:42107)
0924 12:52:43.232448 (+ 1257us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:43.232465 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:43.232523 (+ 58us) server_negotiation.cc:407] Connection header received
0924 12:52:43.234880 (+ 2357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:43.234915 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:43.235609 (+ 694us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:43.236141 (+ 532us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:43.238345 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:43.240458 (+ 2113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:43.242640 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:43.243647 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:43.243878 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:43.249251 (+ 5373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:43.249268 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:43.249303 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:43.249362 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:43.253647 (+ 4285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:43.254677 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:43.254686 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:43.254694 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:43.254926 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:43.255382 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:43.255393 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:43.255402 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:43.256507 (+ 1105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:43.256964 (+ 457us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:43.257703 (+ 739us) server_negotiation.cc:299] Negotiation successful
0924 12:52:43.258266 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":771,"thread_start_us":485,"threads_started":1}
I20260924 12:52:43.262831 15089 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65516dd6dae64e55be6ab3757ec58801" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42107 } }
I20260924 12:52:43.263470 15089 leader_election.cc:302] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65516dd6dae64e55be6ab3757ec58801; no voters:
I20260924 12:52:43.264210 15089 leader_election.cc:288] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:43.264421 15094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:43.265841 15094 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [term 1 LEADER]: Becoming Leader. State: Replica: 65516dd6dae64e55be6ab3757ec58801, State: Running, Role: LEADER
I20260924 12:52:43.266678 15094 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65516dd6dae64e55be6ab3757ec58801" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42107 } }
I20260924 12:52:43.267659 15089 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:43.271054 15095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65516dd6dae64e55be6ab3757ec58801" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65516dd6dae64e55be6ab3757ec58801" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42107 } } }
I20260924 12:52:43.271247 15096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65516dd6dae64e55be6ab3757ec58801. Latest consensus state: current_term: 1 leader_uuid: "65516dd6dae64e55be6ab3757ec58801" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65516dd6dae64e55be6ab3757ec58801" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42107 } } }
I20260924 12:52:43.271782 15095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:43.271865 15096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:43.273087 15100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:43.282948 15100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:43.297696 15100 catalog_manager.cc:1347] Generated new cluster ID: 36406a125db14353bba9158791342df3
I20260924 12:52:43.297859 15100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:43.311070 15100 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:43.313099 15100 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:43.325572 15100 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65516dd6dae64e55be6ab3757ec58801: Generated new TSK 0
I20260924 12:52:43.326970 15100 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:52:43.392638 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42107
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:43.833001 15115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:43.833470 15115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:43.833653 15115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:43.842556 15115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:43.842784 15115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:43.842989 15115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:52:43.855012 15115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:43.857362 15115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:43.860039 15115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:43.878659 15123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:43.879053 15120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:43.879046 15121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:43.880748 15115 server_base.cc:1034] running on GCE node
I20260924 12:52:43.881804 15115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:43.883205 15115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:43.884573 15115 hybrid_clock.cc:648] HybridClock initialized: now 1790254363884479 us; error 57 us; skew 500 ppm
I20260924 12:52:43.885114 15115 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:43 dist-test-slave-m9hg krb5kdc[15009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254363, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:43.893527 15115 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:52:43.895980 15115 webserver.cc:460] Webserver started at http://127.11.49.65:38799/ using document root <none> and password file <none>
I20260924 12:52:43.897118 15115 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:43.897325 15115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:43.897739 15115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:43.902244 15115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "e3a0a2056ff246ee94c1acf87cabc8c4"
format_stamp: "Formatted at 2026-09-24 12:52:43 on dist-test-slave-m9hg"
server_key: "15abe70600b3611b8cdf30e785874095"
server_key_iv: "3f16a99af2948a0fcdcafe83c2140647"
server_key_version: "encryptionkey@0"
I20260924 12:52:43.903506 15115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "e3a0a2056ff246ee94c1acf87cabc8c4"
format_stamp: "Formatted at 2026-09-24 12:52:43 on dist-test-slave-m9hg"
server_key: "15abe70600b3611b8cdf30e785874095"
server_key_iv: "3f16a99af2948a0fcdcafe83c2140647"
server_key_version: "encryptionkey@0"
I20260924 12:52:43.911305 15115 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260924 12:52:43.917145 15130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:43.919318 15115 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.002s
I20260924 12:52:43.919605 15115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "e3a0a2056ff246ee94c1acf87cabc8c4"
format_stamp: "Formatted at 2026-09-24 12:52:43 on dist-test-slave-m9hg"
server_key: "15abe70600b3611b8cdf30e785874095"
server_key_iv: "3f16a99af2948a0fcdcafe83c2140647"
server_key_version: "encryptionkey@0"
I20260924 12:52:43.919903 15115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:43.953353 15115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:43.959287 15115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:43.959684 15115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:43.961056 15115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:43.962829 15115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:43.962956 15115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:43.963140 15115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:43.963230 15115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:44.005339 15115 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:43483
I20260924 12:52:44.005393 15242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:43483 every 8 connection(s)
I20260924 12:52:44.007107 15115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:52:44.011546 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 15115
I20260924 12:52:44.011807 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:52:44.012686 11461 external_mini_cluster.cc:1428] Setting key 3f81cd2c2a994b31a6f51acdafad6abf
Sep 24 12:52:44 dist-test-slave-m9hg krb5kdc[15009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254363, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:44.032092 15245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:44.010347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:39667 (local address 127.11.49.126:42107)
0924 12:52:44.010886 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:44.010891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:44.012357 (+ 1466us) server_negotiation.cc:407] Connection header received
0924 12:52:44.014750 (+ 2393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:44.014756 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:44.014860 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:44.015074 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:44.017585 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:44.018468 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:44.021219 (+ 2751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:44.021709 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:44.021852 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:44.026137 (+ 4285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:44.026144 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:44.026147 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:44.026190 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:44.028846 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:44.029609 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:44.029619 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:44.029622 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:44.029740 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:44.030176 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:44.030182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:44.030199 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:44.030473 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:44.030628 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:44.031465 (+ 837us) server_negotiation.cc:299] Negotiation successful
0924 12:52:44.031711 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":277,"threads_started":1}
I20260924 12:52:44.033161 15246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:44.010945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42107 (local address 127.11.49.65:39667)
0924 12:52:44.012082 (+ 1137us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:44.012157 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:44.014418 (+ 2261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:44.015400 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:44.015412 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:44.016346 (+ 934us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:44.017298 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:44.017329 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:44.018689 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:44.018697 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:44.021001 (+ 2304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:44.021021 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:44.022002 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:44.022012 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:44.022429 (+ 417us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:44.023350 (+ 921us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:44.023409 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:44.025847 (+ 2438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:44.029013 (+ 3166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:44.029023 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:44.029041 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:44.029473 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:44.029848 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:44.029854 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:44.029857 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:44.030048 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:44.030599 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:44.030607 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:44.031038 (+ 431us) client_negotiation.cc:769] Sending connection context
0924 12:52:44.031356 (+ 318us) client_negotiation.cc:240] Negotiation successful
0924 12:52:44.031917 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"thread_start_us":430,"threads_started":1}
I20260924 12:52:44.035111 15243 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42107
I20260924 12:52:44.035450 15243 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:52:44.036233 15243 heartbeater.cc:511] Master 127.11.49.126:42107 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
I20260924 12:52:44.038944 15054 ts_manager.cc:194] Registered new tserver with Master: e3a0a2056ff246ee94c1acf87cabc8c4 (127.11.49.65:43483)
I20260924 12:52:44.041220 15054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:39667
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:52:44.068974 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42107
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:44.490728 15249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:44.491199 15249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:44.491401 15249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:44.500025 15249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:44.500263 15249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:44.500505 15249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:52:44.511822 15249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:44.513695 15249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:44.515420 15249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:44.532358 15254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:44.532419 15255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:44.532380 15257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:44.533253 15249 server_base.cc:1034] running on GCE node
I20260924 12:52:44.534114 15249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:44.535405 15249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:44.536657 15249 hybrid_clock.cc:648] HybridClock initialized: now 1790254364536579 us; error 79 us; skew 500 ppm
I20260924 12:52:44.537070 15249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:44 dist-test-slave-m9hg krb5kdc[15009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254364, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:44.540977 15249 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:52:44.542944 15249 webserver.cc:460] Webserver started at http://127.11.49.66:38807/ using document root <none> and password file <none>
I20260924 12:52:44.543913 15249 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:44.544109 15249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:44.544596 15249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:44.548671 15249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "9885d5f5a8ad4f5daee719e5d2163e53"
format_stamp: "Formatted at 2026-09-24 12:52:44 on dist-test-slave-m9hg"
server_key: "5ad5fd21f57425bb0eab86796c128f58"
server_key_iv: "ecfbf421eeaa200fbd0a26d78c5abae4"
server_key_version: "encryptionkey@0"
I20260924 12:52:44.549820 15249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "9885d5f5a8ad4f5daee719e5d2163e53"
format_stamp: "Formatted at 2026-09-24 12:52:44 on dist-test-slave-m9hg"
server_key: "5ad5fd21f57425bb0eab86796c128f58"
server_key_iv: "ecfbf421eeaa200fbd0a26d78c5abae4"
server_key_version: "encryptionkey@0"
I20260924 12:52:44.557096 15249 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260924 12:52:44.561873 15264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:44.563858 15249 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.001s
I20260924 12:52:44.564247 15249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "9885d5f5a8ad4f5daee719e5d2163e53"
format_stamp: "Formatted at 2026-09-24 12:52:44 on dist-test-slave-m9hg"
server_key: "5ad5fd21f57425bb0eab86796c128f58"
server_key_iv: "ecfbf421eeaa200fbd0a26d78c5abae4"
server_key_version: "encryptionkey@0"
I20260924 12:52:44.564661 15249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:44.587306 15249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:44.593248 15249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:44.593680 15249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:44.595230 15249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:44.597585 15249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:44.597759 15249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:44.597963 15249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:44.598054 15249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:44.638921 15249 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:37815
I20260924 12:52:44.638973 15376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:37815 every 8 connection(s)
I20260924 12:52:44.640658 15249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:52:44.646360 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 15249
I20260924 12:52:44.646624 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:52:44.647111 11461 external_mini_cluster.cc:1428] Setting key 70ffd70bdf5e0f912481ac534638a572
Sep 24 12:52:44 dist-test-slave-m9hg krb5kdc[15009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254364, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:44.663606 15379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:44.643709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:40555 (local address 127.11.49.126:42107)
0924 12:52:44.644212 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:44.644218 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:44.645639 (+ 1421us) server_negotiation.cc:407] Connection header received
0924 12:52:44.647883 (+ 2244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:44.647889 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:44.647993 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:44.648142 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:44.649823 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:44.650579 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:44.652178 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:44.652671 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:44.652819 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:44.657179 (+ 4360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:44.657185 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:44.657189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:44.657227 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:44.660148 (+ 2921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:44.661059 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:44.661065 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:44.661069 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:44.661221 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:44.661703 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:44.661713 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:44.661716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:44.662021 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:44.662189 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:44.662970 (+ 781us) server_negotiation.cc:299] Negotiation successful
0924 12:52:44.663210 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":240,"threads_started":1}
I20260924 12:52:44.664850 15380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:44.644437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42107 (local address 127.11.49.66:40555)
0924 12:52:44.645336 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:44.645392 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:44.647564 (+ 2172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:44.648446 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:44.648455 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:44.649009 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:44.649619 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:44.649635 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:44.650745 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:44.650762 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:44.652017 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:44.652029 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:44.652926 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:44.652933 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:44.653175 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:44.654047 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:44.654074 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:44.656882 (+ 2808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:44.660361 (+ 3479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:44.660373 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:44.660393 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:44.660905 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:44.661347 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:44.661354 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:44.661358 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:44.661569 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:44.662161 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:44.662171 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:44.662576 (+ 405us) client_negotiation.cc:769] Sending connection context
0924 12:52:44.662873 (+ 297us) client_negotiation.cc:240] Negotiation successful
0924 12:52:44.663486 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":336,"threads_started":1}
I20260924 12:52:44.666761 15377 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42107
I20260924 12:52:44.667109 15377 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:44.668143 15377 heartbeater.cc:511] Master 127.11.49.126:42107 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
I20260924 12:52:44.670492 15054 ts_manager.cc:194] Registered new tserver with Master: 9885d5f5a8ad4f5daee719e5d2163e53 (127.11.49.66:37815)
I20260924 12:52:44.671653 15054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:40555
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:52:44.704439 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42107
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:52:45.045511 15243 heartbeater.cc:503] Master 127.11.49.126:42107 was elected leader, sending a full tablet report...
W20260924 12:52:45.123222 15383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:45.123647 15383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:45.123760 15383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:45.132431 15383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:45.132601 15383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:45.132737 15383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:52:45.144014 15383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:45.145871 15383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:45.147641 15383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:45.164080 15391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:45.164021 15389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:45.164021 15388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:45.165800 15383 server_base.cc:1034] running on GCE node
I20260924 12:52:45.166574 15383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:45.167744 15383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:45.169128 15383 hybrid_clock.cc:648] HybridClock initialized: now 1790254365169032 us; error 66 us; skew 500 ppm
I20260924 12:52:45.169554 15383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:45 dist-test-slave-m9hg krb5kdc[15009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254365, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:45.173506 15383 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:52:45.175207 15383 webserver.cc:460] Webserver started at http://127.11.49.67:37967/ using document root <none> and password file <none>
I20260924 12:52:45.175982 15383 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:45.176090 15383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:45.176497 15383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:45.179535 15383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "3697ee929cd04011b2ebebb83e48fff2"
format_stamp: "Formatted at 2026-09-24 12:52:45 on dist-test-slave-m9hg"
server_key: "155266c918dfb09ececf5fd74182ebf3"
server_key_iv: "7854a8001504398cd2364760a267ae19"
server_key_version: "encryptionkey@0"
I20260924 12:52:45.180446 15383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "3697ee929cd04011b2ebebb83e48fff2"
format_stamp: "Formatted at 2026-09-24 12:52:45 on dist-test-slave-m9hg"
server_key: "155266c918dfb09ececf5fd74182ebf3"
server_key_iv: "7854a8001504398cd2364760a267ae19"
server_key_version: "encryptionkey@0"
I20260924 12:52:45.186800 15383 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260924 12:52:45.191280 15398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:45.193223 15383 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:52:45.193444 15383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "3697ee929cd04011b2ebebb83e48fff2"
format_stamp: "Formatted at 2026-09-24 12:52:45 on dist-test-slave-m9hg"
server_key: "155266c918dfb09ececf5fd74182ebf3"
server_key_iv: "7854a8001504398cd2364760a267ae19"
server_key_version: "encryptionkey@0"
I20260924 12:52:45.193676 15383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:45.223300 15383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:45.228845 15383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:45.229202 15383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:45.230356 15383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:45.232079 15383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:45.232197 15383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:45.232373 15383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:45.232451 15383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:45.274600 15383 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:41523
I20260924 12:52:45.274706 15510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:41523 every 8 connection(s)
I20260924 12:52:45.276034 15383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:52:45.280018 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 15383
I20260924 12:52:45.280244 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:52:45.280903 11461 external_mini_cluster.cc:1428] Setting key 3f784ce332f59ab4e4e575fd6ba8c1d9
Sep 24 12:52:45 dist-test-slave-m9hg krb5kdc[15009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254365, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:45.304859 15513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:45.279597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:44591 (local address 127.11.49.126:42107)
0924 12:52:45.280254 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:45.280264 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:45.281825 (+ 1561us) server_negotiation.cc:407] Connection header received
0924 12:52:45.284498 (+ 2673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:45.284503 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:45.284600 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:45.284758 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:45.287076 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.287955 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.290260 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.290726 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.290849 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:45.296148 (+ 5299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:45.296156 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:45.296161 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:45.296208 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:45.300804 (+ 4596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.301921 (+ 1117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.301926 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.301928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.302095 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.302623 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.302628 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.302633 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.302962 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:45.303146 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:45.304051 (+ 905us) server_negotiation.cc:299] Negotiation successful
0924 12:52:45.304380 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":321,"threads_started":1}
I20260924 12:52:45.306164 15514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:45.280305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42107 (local address 127.11.49.67:44591)
0924 12:52:45.281512 (+ 1207us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:45.281599 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:45.284053 (+ 2454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:45.285170 (+ 1117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:45.285183 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:45.285962 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:45.286790 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:45.286815 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.288201 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.288207 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:45.290030 (+ 1823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:45.290063 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.291090 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.291098 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:45.291414 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:45.292478 (+ 1064us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:45.292510 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:45.295783 (+ 3273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:45.301049 (+ 5266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:45.301063 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:45.301095 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:45.301727 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:45.302228 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:45.302233 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:45.302237 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:45.302484 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:45.303104 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:45.303114 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:45.303603 (+ 489us) client_negotiation.cc:769] Sending connection context
0924 12:52:45.303947 (+ 344us) client_negotiation.cc:240] Negotiation successful
0924 12:52:45.304709 (+ 762us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"thread_start_us":508,"threads_started":1}
I20260924 12:52:45.308259 15511 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42107
I20260924 12:52:45.308816 15511 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:45.310109 15511 heartbeater.cc:511] Master 127.11.49.126:42107 requested a full tablet report, sending...
I20260924 12:52:45.312183 15054 ts_manager.cc:194] Registered new tserver with Master: 3697ee929cd04011b2ebebb83e48fff2 (127.11.49.67:41523)
I20260924 12:52:45.313195 15054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:44591
I20260924 12:52:45.325194 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 24 12:52:45 dist-test-slave-m9hg krb5kdc[15009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 24 12:52:45 dist-test-slave-m9hg krb5kdc[15009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:52:45.388751 15519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:45.368637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42238 (local address 127.11.49.65:43483)
0924 12:52:45.369573 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:45.369581 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:45.369616 (+ 35us) server_negotiation.cc:407] Connection header received
0924 12:52:45.369685 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:45.369691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:45.370032 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:45.370197 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:45.372407 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.373611 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.375225 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.375887 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.376009 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:45.381332 (+ 5323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:45.381355 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:45.381377 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:45.381440 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:45.385102 (+ 3662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.386191 (+ 1089us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.386206 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.386213 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.386435 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.386875 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.386878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.386881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.387382 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:45.387731 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:45.388031 (+ 300us) server_negotiation.cc:299] Negotiation successful
0924 12:52:45.388397 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":746,"thread_start_us":510,"threads_started":1}
Sep 24 12:52:45 dist-test-slave-m9hg krb5kdc[15009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:45.410324 15513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:45.394717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54782 (local address 127.11.49.126:42107)
0924 12:52:45.394985 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:45.394990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:45.395171 (+ 181us) server_negotiation.cc:407] Connection header received
0924 12:52:45.395424 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:45.395429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:45.395626 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:45.395783 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:45.397457 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.398347 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.399805 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.400208 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.400373 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:45.404507 (+ 4134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:45.404512 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:45.404516 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:45.404556 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:45.407581 (+ 3025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.408323 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.408328 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.408331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.408449 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.408822 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.408833 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.408835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.409163 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:45.409428 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:45.409722 (+ 294us) server_negotiation.cc:299] Negotiation successful
0924 12:52:45.409957 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
W20260924 12:52:45.411260 15054 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54782
I20260924 12:52:45.412834 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 15115
I20260924 12:52:45.428421 15519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:45.414123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42250 (local address 127.11.49.65:43483)
0924 12:52:45.414331 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:45.414338 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:45.414542 (+ 204us) server_negotiation.cc:407] Connection header received
0924 12:52:45.414705 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:45.414710 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:45.414824 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:45.414941 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:45.416368 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.417180 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.418578 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.419117 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.419256 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:45.421977 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:45.421984 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:45.421989 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:45.422040 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:45.425529 (+ 3489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.426416 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.426420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.426422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.426637 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.427034 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.427037 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.427039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.427341 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:45.427564 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:45.427820 (+ 256us) server_negotiation.cc:299] Negotiation successful
0924 12:52:45.428045 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260924 12:52:45.429260 15238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:45.525053 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 15115
I20260924 12:52:45.546281 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 15249
Sep 24 12:52:45 dist-test-slave-m9hg krb5kdc[15009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:52:45.569653 15524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:45.547618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34596 (local address 127.11.49.66:37815)
0924 12:52:45.548456 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:45.548465 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:45.548494 (+ 29us) server_negotiation.cc:407] Connection header received
0924 12:52:45.548570 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:45.548576 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:45.548819 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:45.549021 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:45.550366 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.551442 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.552907 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.553693 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.553902 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:45.558907 (+ 5005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:45.558923 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:45.558940 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:45.558982 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:45.564350 (+ 5368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.565888 (+ 1538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.565899 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.565903 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.566088 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.566537 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.566542 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.566546 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.567336 (+ 790us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:45.567727 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:45.568678 (+ 951us) server_negotiation.cc:299] Negotiation successful
0924 12:52:45.569145 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":407,"threads_started":1}
I20260924 12:52:45.572752 15372 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:45.685386 15377 heartbeater.cc:503] Master 127.11.49.126:42107 was elected leader, sending a full tablet report...
I20260924 12:52:45.687299 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 15249
W20260924 12:52:45.706281 15041 connection.cc:535] server connection from 127.11.49.66:40555 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260924 12:52:45.706750 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 15383
Sep 24 12:52:45 dist-test-slave-m9hg krb5kdc[15009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:52:45.727888 15526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:45.707883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39594 (local address 127.11.49.67:41523)
0924 12:52:45.708549 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:45.708558 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:45.708596 (+ 38us) server_negotiation.cc:407] Connection header received
0924 12:52:45.708669 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:45.708676 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:45.708908 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:45.709125 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:45.710890 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.711954 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.714028 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:45.714687 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:45.714816 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:45.720659 (+ 5843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:45.720674 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:45.720692 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:45.720755 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:45.723941 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.725329 (+ 1388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.725339 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.725342 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.725493 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:45.726035 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:45.726038 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:45.726040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:45.726434 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:45.726672 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:45.727232 (+ 560us) server_negotiation.cc:299] Negotiation successful
0924 12:52:45.727474 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":303,"threads_started":1}
I20260924 12:52:45.729573 15506 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:45.823649 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 15383
I20260924 12:52:45.841873 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 15022
I20260924 12:52:45.843299 15084 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:45.962931 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 15022
2026-09-24T12:52:45Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4710 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:52:46 dist-test-slave-m9hg krb5kdc[15531](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:52:46 dist-test-slave-m9hg krb5kdc[15531](info): set up 2 sockets
Sep 24 12:52:46 dist-test-slave-m9hg krb5kdc[15531](info): commencing operation
krb5kdc: starting...
W20260924 12:52:47.093340 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.007s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:52:47 dist-test-slave-m9hg krb5kdc[15531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:52:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:52:47.333174 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:41491
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:41491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:47.708712 15544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:47.709046 15544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:47.709146 15544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:47.716976 15544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:47.717108 15544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:47.717155 15544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:47.717248 15544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:47.717337 15544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:52:47.727891 15544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:41491
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:41491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:47.729337 15544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:47.730715 15544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:47.743599 15549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:47.743578 15552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:47.743786 15550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:47.745754 15544 server_base.cc:1034] running on GCE node
I20260924 12:52:47.747134 15544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:47.749514 15544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:47.750813 15544 hybrid_clock.cc:648] HybridClock initialized: now 1790254367750731 us; error 81 us; skew 500 ppm
I20260924 12:52:47.751336 15544 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:47 dist-test-slave-m9hg krb5kdc[15531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254367, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:47.755846 15544 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:52:47.757705 15544 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:47.757915 15544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:47.758431 15544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:47.762903 15544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "2e2e74b429df40878f42d943dc10f0e0"
format_stamp: "Formatted at 2026-09-24 12:52:47 on dist-test-slave-m9hg"
server_key: "c4621c6b03c3f303327bbbb76360534e"
server_key_iv: "b6dfaaabb06d56c8f3c2f9fca0f33057"
server_key_version: "encryptionkey@0"
I20260924 12:52:47.764187 15544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "2e2e74b429df40878f42d943dc10f0e0"
format_stamp: "Formatted at 2026-09-24 12:52:47 on dist-test-slave-m9hg"
server_key: "c4621c6b03c3f303327bbbb76360534e"
server_key_iv: "b6dfaaabb06d56c8f3c2f9fca0f33057"
server_key_version: "encryptionkey@0"
I20260924 12:52:47.772001 15544 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260924 12:52:47.777487 15558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:47.779835 15544 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260924 12:52:47.780164 15544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "2e2e74b429df40878f42d943dc10f0e0"
format_stamp: "Formatted at 2026-09-24 12:52:47 on dist-test-slave-m9hg"
server_key: "c4621c6b03c3f303327bbbb76360534e"
server_key_iv: "b6dfaaabb06d56c8f3c2f9fca0f33057"
server_key_version: "encryptionkey@0"
I20260924 12:52:47.780586 15544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:47.798007 15544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:47.804405 15544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:47.804814 15544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:47.829792 15544 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:41491
I20260924 12:52:47.829818 15609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:41491 every 8 connection(s)
I20260924 12:52:47.831076 15544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:47.835289 15610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:47.841265 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 15544
I20260924 12:52:47.841612 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:47.842315 11461 external_mini_cluster.cc:1428] Setting key ee48364129e9d9291851919d494a7964
I20260924 12:52:47.848800 15610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0: Bootstrap starting.
I20260924 12:52:47.853086 15610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:47.854219 15610 log.cc:824] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:47.857846 15610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0: No bootstrap required, opened a new log
Sep 24 12:52:47 dist-test-slave-m9hg krb5kdc[15531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:47.866168 15610 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2e74b429df40878f42d943dc10f0e0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41491 } }
I20260924 12:52:47.866608 15610 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:47.866768 15610 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2e74b429df40878f42d943dc10f0e0, State: Initialized, Role: FOLLOWER
I20260924 12:52:47.867509 15610 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2e74b429df40878f42d943dc10f0e0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41491 } }
I20260924 12:52:47.867939 15610 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:47.868129 15610 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:47.868373 15610 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:47.870894 15610 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2e74b429df40878f42d943dc10f0e0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41491 } }
I20260924 12:52:47.871502 15610 leader_election.cc:302] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e2e74b429df40878f42d943dc10f0e0; no voters:
I20260924 12:52:47.872342 15610 leader_election.cc:288] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:47.872548 15615 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:47.873409 15615 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2e74b429df40878f42d943dc10f0e0, State: Running, Role: LEADER
I20260924 12:52:47.874224 15615 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2e74b429df40878f42d943dc10f0e0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41491 } }
I20260924 12:52:47.876842 15615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e2e74b429df40878f42d943dc10f0e0. Latest consensus state: current_term: 1 leader_uuid: "2e2e74b429df40878f42d943dc10f0e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2e74b429df40878f42d943dc10f0e0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41491 } } }
I20260924 12:52:47.877640 15617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e2e74b429df40878f42d943dc10f0e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2e74b429df40878f42d943dc10f0e0" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41491 } } }
I20260924 12:52:47.877964 15617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:47.878278 15613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:47.845428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32908 (local address 127.11.49.126:41491)
0924 12:52:47.848383 (+ 2955us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:47.848404 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:47.848470 (+ 66us) server_negotiation.cc:407] Connection header received
0924 12:52:47.851053 (+ 2583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:47.851089 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:47.851656 (+ 567us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:47.852147 (+ 491us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:47.854250 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:47.856101 (+ 1851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:47.858149 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:47.859176 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:47.859480 (+ 304us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:47.865088 (+ 5608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:47.865100 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:47.865130 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:47.865198 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:47.869967 (+ 4769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:47.871061 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:47.871075 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:47.871088 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:47.871340 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:47.871941 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:47.871950 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:47.871956 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:47.873149 (+ 1193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:47.875220 (+ 2071us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:47.875640 (+ 420us) server_negotiation.cc:299] Negotiation successful
0924 12:52:47.876376 (+ 736us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":2620,"thread_start_us":2285,"threads_started":1}
I20260924 12:52:47.879158 15615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:47.879309 15610 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:47.879592 15619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:47.892204 15619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:47.905957 15619 catalog_manager.cc:1347] Generated new cluster ID: c38c6f126a8d42628ce49595d66ffab2
I20260924 12:52:47.906137 15619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:47.929850 15619 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:47.931790 15619 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:47.941480 15619 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0: Generated new TSK 0
I20260924 12:52:47.942576 15619 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:52:48.005740 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41491
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:48.425113 15636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:48.425508 15636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:48.425689 15636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:48.434360 15636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:48.434537 15636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:48.434758 15636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:52:48.446722 15636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:48.448674 15636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:48.450414 15636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:48.467293 15642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:48.467361 15641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:48.467949 15644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:48.468672 15636 server_base.cc:1034] running on GCE node
I20260924 12:52:48.469419 15636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:48.470613 15636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:48.471921 15636 hybrid_clock.cc:648] HybridClock initialized: now 1790254368471873 us; error 44 us; skew 500 ppm
I20260924 12:52:48.472381 15636 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:48 dist-test-slave-m9hg krb5kdc[15531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254368, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:48.475742 15636 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:52:48.477134 15636 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:48.477246 15636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:48.477517 15636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:48.480718 15636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "867c25de6b674ed9a435915c6f1c4b34"
format_stamp: "Formatted at 2026-09-24 12:52:48 on dist-test-slave-m9hg"
server_key: "0e38d019d68ded9a581953250bd33c7c"
server_key_iv: "888ff10cf0cacad2ad49aafbe7de27ab"
server_key_version: "encryptionkey@0"
I20260924 12:52:48.481510 15636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "867c25de6b674ed9a435915c6f1c4b34"
format_stamp: "Formatted at 2026-09-24 12:52:48 on dist-test-slave-m9hg"
server_key: "0e38d019d68ded9a581953250bd33c7c"
server_key_iv: "888ff10cf0cacad2ad49aafbe7de27ab"
server_key_version: "encryptionkey@0"
I20260924 12:52:48.487695 15636 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260924 12:52:48.491817 15650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:48.493654 15636 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:52:48.493831 15636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "867c25de6b674ed9a435915c6f1c4b34"
format_stamp: "Formatted at 2026-09-24 12:52:48 on dist-test-slave-m9hg"
server_key: "0e38d019d68ded9a581953250bd33c7c"
server_key_iv: "888ff10cf0cacad2ad49aafbe7de27ab"
server_key_version: "encryptionkey@0"
I20260924 12:52:48.494104 15636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:48.517983 15636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:48.522778 15636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:48.523043 15636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:48.524397 15636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:48.525945 15636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:48.526044 15636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:48.526206 15636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:48.526302 15636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:48.566545 15636 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:38845
I20260924 12:52:48.566679 15762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:38845 every 8 connection(s)
I20260924 12:52:48.567512 15636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:52:48.576403 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 15636
I20260924 12:52:48.576684 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:52:48.577570 11461 external_mini_cluster.cc:1428] Setting key 2412fa33fca7c7b07233790f21f91656
Sep 24 12:52:48 dist-test-slave-m9hg krb5kdc[15531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254368, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:48.592918 15765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:48.570716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:57325 (local address 127.11.49.126:41491)
0924 12:52:48.571296 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:48.571302 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:48.572210 (+ 908us) server_negotiation.cc:407] Connection header received
0924 12:52:48.574540 (+ 2330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:48.574547 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:48.574682 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:48.574831 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:48.577450 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:48.578429 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:48.581040 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:48.581498 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:48.581667 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:48.586506 (+ 4839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:48.586512 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:48.586516 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:48.586552 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:48.589600 (+ 3048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:48.590438 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:48.590447 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:48.590450 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:48.590566 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:48.591014 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:48.591019 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:48.591022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:48.591312 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:48.591481 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:48.592247 (+ 766us) server_negotiation.cc:299] Negotiation successful
0924 12:52:48.592541 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":343,"threads_started":1}
I20260924 12:52:48.593993 15766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:48.571129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:41491 (local address 127.11.49.65:57325)
0924 12:52:48.571988 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:48.572042 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:48.574139 (+ 2097us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:48.575134 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:48.575146 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:48.575977 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:48.577113 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:48.577150 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:48.578691 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:48.578697 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:48.580504 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:48.580528 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:48.581867 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:48.581876 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:48.582098 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:48.583090 (+ 992us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:48.583115 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:48.586216 (+ 3101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:48.589780 (+ 3564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:48.589790 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:48.589818 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:48.590291 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:48.590680 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:48.590686 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:48.590689 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:48.590888 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:48.591445 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:48.591455 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:48.591850 (+ 395us) client_negotiation.cc:769] Sending connection context
0924 12:52:48.592132 (+ 282us) client_negotiation.cc:240] Negotiation successful
0924 12:52:48.592736 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":332,"threads_started":1}
I20260924 12:52:48.596184 15763 heartbeater.cc:347] Connected to a master server at 127.11.49.126:41491
I20260924 12:52:48.596899 15763 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:48.598134 15763 heartbeater.cc:511] Master 127.11.49.126:41491 requested a full tablet report, sending...
I20260924 12:52:48.601760 15575 ts_manager.cc:194] Registered new tserver with Master: 867c25de6b674ed9a435915c6f1c4b34 (127.11.49.65:38845)
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:52:48.604413 15575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:57325
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:52:48.637295 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41491
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:52:49.057293 15769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:49.057709 15769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:49.057826 15769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:49.067106 15769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:49.067304 15769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:49.067449 15769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:52:49.080113 15769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:49.082064 15769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:49.083786 15769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:49.103309 15774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:49.103283 15775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:49.103714 15777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:49.104807 15769 server_base.cc:1034] running on GCE node
I20260924 12:52:49.105710 15769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:49.107098 15769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:49.108536 15769 hybrid_clock.cc:648] HybridClock initialized: now 1790254369108425 us; error 82 us; skew 500 ppm
I20260924 12:52:49.109037 15769 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:49 dist-test-slave-m9hg krb5kdc[15531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254369, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:49.118083 15769 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:52:49.120033 15769 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:49.120253 15769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:49.120788 15769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:49.124995 15769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "a22b2590edb44cfc898120e7d53d43bd"
format_stamp: "Formatted at 2026-09-24 12:52:49 on dist-test-slave-m9hg"
server_key: "f8c55fb5dccf345ed85918f59ab7442b"
server_key_iv: "15985493ebbe65c93993be0a92cb2cac"
server_key_version: "encryptionkey@0"
I20260924 12:52:49.126543 15769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "a22b2590edb44cfc898120e7d53d43bd"
format_stamp: "Formatted at 2026-09-24 12:52:49 on dist-test-slave-m9hg"
server_key: "f8c55fb5dccf345ed85918f59ab7442b"
server_key_iv: "15985493ebbe65c93993be0a92cb2cac"
server_key_version: "encryptionkey@0"
I20260924 12:52:49.134654 15769 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260924 12:52:49.140393 15783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:49.142539 15769 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260924 12:52:49.142824 15769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "a22b2590edb44cfc898120e7d53d43bd"
format_stamp: "Formatted at 2026-09-24 12:52:49 on dist-test-slave-m9hg"
server_key: "f8c55fb5dccf345ed85918f59ab7442b"
server_key_iv: "15985493ebbe65c93993be0a92cb2cac"
server_key_version: "encryptionkey@0"
I20260924 12:52:49.143154 15769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:49.164716 15769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:49.170960 15769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:49.171383 15769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:49.172922 15769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:49.174867 15769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:49.174986 15769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:49.175127 15769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:49.175207 15769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:49.218542 15769 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:43591
I20260924 12:52:49.218689 15895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:43591 every 8 connection(s)
I20260924 12:52:49.219722 15769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:52:49.224081 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 15769
I20260924 12:52:49.224443 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:52:49.225114 11461 external_mini_cluster.cc:1428] Setting key d2ef759ff6e51e74f27332dfb09d6e01
Sep 24 12:52:49 dist-test-slave-m9hg krb5kdc[15531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254369, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:49.247435 15898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.223107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:37359 (local address 127.11.49.126:41491)
0924 12:52:49.223661 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:49.223665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:49.225210 (+ 1545us) server_negotiation.cc:407] Connection header received
0924 12:52:49.227459 (+ 2249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:49.227465 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:49.227577 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:49.227720 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:49.229820 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.230650 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.232649 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.233134 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.233284 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:49.238344 (+ 5060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:49.238354 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:49.238363 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:49.238415 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:49.242429 (+ 4014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:49.243845 (+ 1416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:49.243854 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:49.243860 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:49.244038 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:49.244799 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:49.244807 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:49.244814 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:49.245273 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:49.245466 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:49.246704 (+ 1238us) server_negotiation.cc:299] Negotiation successful
0924 12:52:49.246980 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":282,"threads_started":1}
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
I20260924 12:52:49.249416 15899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.223792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:41491 (local address 127.11.49.66:37359)
0924 12:52:49.224999 (+ 1207us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:49.225056 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:49.227116 (+ 2060us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:49.227983 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:49.227992 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:49.228842 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:49.229579 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.229600 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.230847 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.230851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:49.232472 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.232486 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.233407 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.233414 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:49.233663 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:49.234613 (+ 950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:49.234651 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:49.237969 (+ 3318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:49.242769 (+ 4800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:49.242782 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:49.242831 (+ 49us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:49.243615 (+ 784us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:49.244265 (+ 650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:49.244324 (+ 59us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:49.244328 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:49.244626 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:49.245608 (+ 982us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:49.245617 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:49.246189 (+ 572us) client_negotiation.cc:769] Sending connection context
0924 12:52:49.246537 (+ 348us) client_negotiation.cc:240] Negotiation successful
0924 12:52:49.247331 (+ 794us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":886,"thread_start_us":548,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
I20260924 12:52:49.251860 15896 heartbeater.cc:347] Connected to a master server at 127.11.49.126:41491
I20260924 12:52:49.252444 15896 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:49.253685 15896 heartbeater.cc:511] Master 127.11.49.126:41491 requested a full tablet report, sending...
I20260924 12:52:49.256652 15575 ts_manager.cc:194] Registered new tserver with Master: a22b2590edb44cfc898120e7d53d43bd (127.11.49.66:43591)
I20260924 12:52:49.257802 15575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:37359
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:52:49.286115 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41491
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:52:49.609241 15763 heartbeater.cc:503] Master 127.11.49.126:41491 was elected leader, sending a full tablet report...
W20260924 12:52:49.656141 15902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:49.656551 15902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:49.656666 15902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:49.664222 15902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:49.664400 15902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:49.664525 15902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:52:49.674628 15902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:49.675959 15902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:49.677366 15902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:49.693696 15908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:49.693661 15907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:49.694146 15910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:49.695631 15902 server_base.cc:1034] running on GCE node
I20260924 12:52:49.696810 15902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:49.698791 15902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:49.700106 15902 hybrid_clock.cc:648] HybridClock initialized: now 1790254369699968 us; error 118 us; skew 500 ppm
I20260924 12:52:49.700672 15902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:52:49 dist-test-slave-m9hg krb5kdc[15531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254369, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:52:49.706385 15902 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:52:49.708209 15902 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:49.708439 15902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:49.708806 15902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:49.712883 15902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "b11da79d4d4948fbadb142c2351211ee"
format_stamp: "Formatted at 2026-09-24 12:52:49 on dist-test-slave-m9hg"
server_key: "2403c50aaefa03c9cfd6e3fe61179983"
server_key_iv: "7569ee86bc783886c9da4e2b287121f2"
server_key_version: "encryptionkey@0"
I20260924 12:52:49.714001 15902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "b11da79d4d4948fbadb142c2351211ee"
format_stamp: "Formatted at 2026-09-24 12:52:49 on dist-test-slave-m9hg"
server_key: "2403c50aaefa03c9cfd6e3fe61179983"
server_key_iv: "7569ee86bc783886c9da4e2b287121f2"
server_key_version: "encryptionkey@0"
I20260924 12:52:49.721509 15902 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260924 12:52:49.727699 15916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:49.730190 15902 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260924 12:52:49.730499 15902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "b11da79d4d4948fbadb142c2351211ee"
format_stamp: "Formatted at 2026-09-24 12:52:49 on dist-test-slave-m9hg"
server_key: "2403c50aaefa03c9cfd6e3fe61179983"
server_key_iv: "7569ee86bc783886c9da4e2b287121f2"
server_key_version: "encryptionkey@0"
I20260924 12:52:49.730815 15902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:49.754022 15902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:49.761418 15902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:49.761853 15902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:49.763542 15902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:49.766134 15902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:49.766297 15902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:49.766454 15902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:49.766559 15902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:49.812834 15902 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:45011
I20260924 12:52:49.812887 16028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:45011 every 8 connection(s)
I20260924 12:52:49.814157 15902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:52:49.814823 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 15902
I20260924 12:52:49.815112 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:52:49.815810 11461 external_mini_cluster.cc:1428] Setting key 0e29ef2084d029e3e5fcc9d44b3db3a9
Sep 24 12:52:49 dist-test-slave-m9hg krb5kdc[15531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254369, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:52:49.842886 16032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.819100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:48701 (local address 127.11.49.126:41491)
0924 12:52:49.819569 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:49.819576 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:49.820105 (+ 529us) server_negotiation.cc:407] Connection header received
0924 12:52:49.822617 (+ 2512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:49.822623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:49.822768 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:49.822907 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:49.825276 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.826156 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.828135 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.828859 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.829080 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:49.834426 (+ 5346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:49.834434 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:49.834440 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:49.834491 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:49.838438 (+ 3947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:49.839684 (+ 1246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:49.839689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:49.839691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:49.839840 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:49.840579 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:49.840582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:49.840584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:49.840929 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:49.841045 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:49.842174 (+ 1129us) server_negotiation.cc:299] Negotiation successful
0924 12:52:49.842444 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":1028,"threads_started":1}
I20260924 12:52:49.844823 16031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.818577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:41491 (local address 127.11.49.67:48701)
0924 12:52:49.819852 (+ 1275us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:49.819915 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:49.822194 (+ 2279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:49.823276 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:49.823288 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:49.824072 (+ 784us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:49.824992 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.825017 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.826357 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.826363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:49.827899 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.827919 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.829237 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.829246 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:49.829615 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:49.830672 (+ 1057us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:52:49.830715 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:49.834133 (+ 3418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:49.838696 (+ 4563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:49.838708 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:49.838729 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:49.839495 (+ 766us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:49.840038 (+ 543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:52:49.840044 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:52:49.840047 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:52:49.840443 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:52:49.841125 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:49.841134 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:49.841676 (+ 542us) client_negotiation.cc:769] Sending connection context
0924 12:52:49.842059 (+ 383us) client_negotiation.cc:240] Negotiation successful
0924 12:52:49.842866 (+ 807us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"thread_start_us":490,"threads_started":1}
I20260924 12:52:49.847180 16029 heartbeater.cc:347] Connected to a master server at 127.11.49.126:41491
I20260924 12:52:49.847594 16029 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:49.848448 16029 heartbeater.cc:511] Master 127.11.49.126:41491 requested a full tablet report, sending...
I20260924 12:52:49.850652 15574 ts_manager.cc:194] Registered new tserver with Master: b11da79d4d4948fbadb142c2351211ee (127.11.49.67:45011)
I20260924 12:52:49.851811 15574 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:48701
I20260924 12:52:49.860832 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:52:49.883648 16032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.866874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32918 (local address 127.11.49.126:41491)
0924 12:52:49.867048 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:49.867053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:49.867538 (+ 485us) server_negotiation.cc:407] Connection header received
0924 12:52:49.867726 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:49.867731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:49.867802 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:49.867907 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:49.870264 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.871057 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.872851 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.873324 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.873450 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:49.876824 (+ 3374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:49.876830 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:49.876834 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:49.876881 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:49.879857 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:49.881093 (+ 1236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:49.881098 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:49.881100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:49.881248 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:49.881862 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:49.881867 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:49.881869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:49.882278 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:49.882492 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:49.883032 (+ 540us) server_negotiation.cc:299] Negotiation successful
0924 12:52:49.883342 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260924 12:52:49.890859 15574 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:52:49.899421 15574 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:52:49.929837 16045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.917462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:43591 (local address 127.0.0.1:58112)
0924 12:52:49.921726 (+ 4264us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:49.921743 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:49.921924 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:49.922541 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:49.922545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:49.922570 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:49.922977 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.922988 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.924850 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.924860 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:49.926607 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.926620 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.928636 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.928644 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:49.928870 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:49.928927 (+ 57us) client_negotiation.cc:769] Sending connection context
0924 12:52:49.929087 (+ 160us) client_negotiation.cc:240] Negotiation successful
0924 12:52:49.929316 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4109,"mutex_wait_us":1,"thread_start_us":3957,"threads_started":1}
I20260924 12:52:49.930408 16043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.916823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:45011 (local address 127.0.0.1:47358)
0924 12:52:49.917869 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:49.917927 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:49.918168 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:49.920382 (+ 2214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:49.920390 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:49.920424 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:49.920984 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.921002 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.923495 (+ 2493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.923501 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:49.927131 (+ 3630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.927157 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.929438 (+ 2281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.929445 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:49.929607 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:49.929637 (+ 30us) client_negotiation.cc:769] Sending connection context
0924 12:52:49.929705 (+ 68us) client_negotiation.cc:240] Negotiation successful
0924 12:52:49.929842 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"mutex_wait_us":286,"thread_start_us":2569,"threads_started":1}
I20260924 12:52:49.930698 16046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.917705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36054 (local address 127.11.49.65:38845)
0924 12:52:49.918956 (+ 1251us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:49.918968 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:49.919580 (+ 612us) server_negotiation.cc:407] Connection header received
0924 12:52:49.919902 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:49.919909 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:49.920110 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:49.920335 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:49.921461 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.923298 (+ 1837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.927399 (+ 4101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.928977 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.929117 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:49.929322 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:49.929980 (+ 658us) server_negotiation.cc:299] Negotiation successful
0924 12:52:49.930160 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1007,"spinlock_wait_cycles":33024,"thread_start_us":964,"threads_started":1}
I20260924 12:52:49.930928 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.918122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58112 (local address 127.11.49.66:43591)
0924 12:52:49.921189 (+ 3067us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:49.921202 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:49.921855 (+ 653us) server_negotiation.cc:407] Connection header received
0924 12:52:49.922094 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:49.922105 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:49.922350 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:49.922559 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:49.923151 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.924695 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.926766 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.928045 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.928209 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:49.928474 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:49.930390 (+ 1916us) server_negotiation.cc:299] Negotiation successful
0924 12:52:49.930584 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2855,"thread_start_us":2703,"threads_started":1}
I20260924 12:52:49.931493 16042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.916937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:38845 (local address 127.0.0.1:36054)
0924 12:52:49.919450 (+ 2513us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:49.919474 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:49.919701 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:49.920692 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:49.920696 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:49.920716 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:49.921218 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.921229 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.923495 (+ 2266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.923501 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:49.927131 (+ 3630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.927157 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.929502 (+ 2345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.929509 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:49.929706 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:49.929744 (+ 38us) client_negotiation.cc:769] Sending connection context
0924 12:52:49.930947 (+ 1203us) client_negotiation.cc:240] Negotiation successful
0924 12:52:49.931119 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2365,"mutex_wait_us":235,"thread_start_us":1007,"threads_started":1}
I20260924 12:52:49.931856 16044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.916990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47358 (local address 127.11.49.67:45011)
0924 12:52:49.919509 (+ 2519us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:49.919520 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:49.919561 (+ 41us) server_negotiation.cc:407] Connection header received
0924 12:52:49.919702 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:49.919711 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:49.920054 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:49.921237 (+ 1183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:49.921622 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.923298 (+ 1676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.927412 (+ 4114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.929156 (+ 1744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.930351 (+ 1195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:49.931043 (+ 692us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:49.931144 (+ 101us) server_negotiation.cc:299] Negotiation successful
0924 12:52:49.931319 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2325,"thread_start_us":2127,"threads_started":1}
I20260924 12:52:49.935237 15698 tablet_service.cc:1467] Processing CreateTablet for tablet ebc8ed72db2441d5a92c8d866c6eeb2e (DEFAULT_TABLE table=test-table [id=af5503ea6b0741dcaec965761912db8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:49.935238 15831 tablet_service.cc:1467] Processing CreateTablet for tablet ebc8ed72db2441d5a92c8d866c6eeb2e (DEFAULT_TABLE table=test-table [id=af5503ea6b0741dcaec965761912db8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:49.936874 15831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebc8ed72db2441d5a92c8d866c6eeb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:49.936884 15698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebc8ed72db2441d5a92c8d866c6eeb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:49.936360 15964 tablet_service.cc:1467] Processing CreateTablet for tablet ebc8ed72db2441d5a92c8d866c6eeb2e (DEFAULT_TABLE table=test-table [id=af5503ea6b0741dcaec965761912db8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:49.938124 15964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebc8ed72db2441d5a92c8d866c6eeb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:49.952991 16048 tablet_bootstrap.cc:492] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: Bootstrap starting.
I20260924 12:52:49.957773 16048 tablet_bootstrap.cc:654] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:49.958954 16049 tablet_bootstrap.cc:492] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd: Bootstrap starting.
I20260924 12:52:49.958954 16050 tablet_bootstrap.cc:492] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: Bootstrap starting.
I20260924 12:52:49.960629 16048 log.cc:824] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:49.963289 16050 tablet_bootstrap.cc:654] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:49.964946 16049 tablet_bootstrap.cc:654] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:49.964924 16050 log.cc:824] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:49.966140 16049 log.cc:824] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:49.966184 16048 tablet_bootstrap.cc:492] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: No bootstrap required, opened a new log
I20260924 12:52:49.966584 16048 ts_tablet_manager.cc:1397] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.006s
I20260924 12:52:49.969211 16050 tablet_bootstrap.cc:492] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: No bootstrap required, opened a new log
I20260924 12:52:49.969723 16050 ts_tablet_manager.cc:1397] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20260924 12:52:49.972016 16049 tablet_bootstrap.cc:492] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd: No bootstrap required, opened a new log
I20260924 12:52:49.972427 16049 ts_tablet_manager.cc:1397] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260924 12:52:49.977520 16050 raft_consensus.cc:348] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11da79d4d4948fbadb142c2351211ee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45011 } } peers { permanent_uuid: "867c25de6b674ed9a435915c6f1c4b34" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38845 } } peers { permanent_uuid: "a22b2590edb44cfc898120e7d53d43bd" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43591 } }
I20260924 12:52:49.977936 16050 raft_consensus.cc:374] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:49.978030 16050 raft_consensus.cc:729] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 867c25de6b674ed9a435915c6f1c4b34, State: Initialized, Role: FOLLOWER
I20260924 12:52:49.978250 16048 raft_consensus.cc:348] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11da79d4d4948fbadb142c2351211ee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45011 } } peers { permanent_uuid: "867c25de6b674ed9a435915c6f1c4b34" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38845 } } peers { permanent_uuid: "a22b2590edb44cfc898120e7d53d43bd" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43591 } }
I20260924 12:52:49.978811 16048 raft_consensus.cc:374] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:49.978696 16050 consensus_queue.cc:260] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11da79d4d4948fbadb142c2351211ee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45011 } } peers { permanent_uuid: "867c25de6b674ed9a435915c6f1c4b34" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38845 } } peers { permanent_uuid: "a22b2590edb44cfc898120e7d53d43bd" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43591 } }
I20260924 12:52:49.978943 16048 raft_consensus.cc:729] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b11da79d4d4948fbadb142c2351211ee, State: Initialized, Role: FOLLOWER
I20260924 12:52:49.979820 16048 consensus_queue.cc:260] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11da79d4d4948fbadb142c2351211ee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45011 } } peers { permanent_uuid: "867c25de6b674ed9a435915c6f1c4b34" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38845 } } peers { permanent_uuid: "a22b2590edb44cfc898120e7d53d43bd" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43591 } }
I20260924 12:52:49.980901 16050 ts_tablet_manager.cc:1428] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: Time spent starting tablet: real 0.011s user 0.006s sys 0.005s
I20260924 12:52:49.981937 16029 heartbeater.cc:503] Master 127.11.49.126:41491 was elected leader, sending a full tablet report...
I20260924 12:52:49.982779 16048 ts_tablet_manager.cc:1428] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: Time spent starting tablet: real 0.016s user 0.004s sys 0.013s
I20260924 12:52:49.984411 16049 raft_consensus.cc:348] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11da79d4d4948fbadb142c2351211ee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45011 } } peers { permanent_uuid: "867c25de6b674ed9a435915c6f1c4b34" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38845 } } peers { permanent_uuid: "a22b2590edb44cfc898120e7d53d43bd" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43591 } }
I20260924 12:52:49.985014 16049 raft_consensus.cc:374] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:49.985126 16049 raft_consensus.cc:729] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a22b2590edb44cfc898120e7d53d43bd, State: Initialized, Role: FOLLOWER
I20260924 12:52:49.986124 16049 consensus_queue.cc:260] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11da79d4d4948fbadb142c2351211ee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45011 } } peers { permanent_uuid: "867c25de6b674ed9a435915c6f1c4b34" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38845 } } peers { permanent_uuid: "a22b2590edb44cfc898120e7d53d43bd" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43591 } }
I20260924 12:52:49.987838 15896 heartbeater.cc:503] Master 127.11.49.126:41491 was elected leader, sending a full tablet report...
I20260924 12:52:49.988730 16049 ts_tablet_manager.cc:1428] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd: Time spent starting tablet: real 0.016s user 0.015s sys 0.001s
I20260924 12:52:49.992563 16055 raft_consensus.cc:482] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:52:49.992913 16055 raft_consensus.cc:504] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11da79d4d4948fbadb142c2351211ee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45011 } } peers { permanent_uuid: "867c25de6b674ed9a435915c6f1c4b34" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38845 } } peers { permanent_uuid: "a22b2590edb44cfc898120e7d53d43bd" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43591 } }
I20260924 12:52:49.995415 16055 leader_election.cc:288] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 867c25de6b674ed9a435915c6f1c4b34 (127.11.49.65:38845), a22b2590edb44cfc898120e7d53d43bd (127.11.49.66:43591)
I20260924 12:52:50.005091 16031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.995677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:43591 (local address 127.11.49.67:34229)
0924 12:52:49.996533 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:49.996557 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:49.996714 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:49.997146 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:49.997153 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:49.997203 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:49.997588 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.997605 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.999316 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:49.999324 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:50.001890 (+ 2566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:50.001913 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.004010 (+ 2097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.004019 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:50.004313 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:50.004358 (+ 45us) client_negotiation.cc:769] Sending connection context
0924 12:52:50.004485 (+ 127us) client_negotiation.cc:240] Negotiation successful
0924 12:52:50.004668 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":83}
I20260924 12:52:50.005143 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.996237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:34229 (local address 127.11.49.66:43591)
0924 12:52:49.996539 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:49.996549 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:49.996618 (+ 69us) server_negotiation.cc:407] Connection header received
0924 12:52:49.996868 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:49.996877 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:49.996968 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:49.997075 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:49.997854 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:49.999116 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.002124 (+ 3008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.003604 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.003784 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:50.003888 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:50.004589 (+ 701us) server_negotiation.cc:299] Negotiation successful
0924 12:52:50.004799 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260924 12:52:50.006500 16057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.995681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:38845 (local address 127.11.49.67:33381)
0924 12:52:49.997930 (+ 2249us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:49.997955 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:49.998090 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:49.998452 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:49.998457 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:49.998491 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:52:49.999044 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:49.999058 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.000709 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.000715 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:50.003569 (+ 2854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:50.003620 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.005551 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.005558 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:50.005747 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:50.005776 (+ 29us) client_negotiation.cc:769] Sending connection context
0924 12:52:50.005875 (+ 99us) client_negotiation.cc:240] Negotiation successful
0924 12:52:50.006050 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2042,"mutex_wait_us":1212,"thread_start_us":568,"threads_started":1}
I20260924 12:52:50.006537 16046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:49.996259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:33381 (local address 127.11.49.65:38845)
0924 12:52:49.996601 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:49.996610 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:49.998037 (+ 1427us) server_negotiation.cc:407] Connection header received
0924 12:52:49.998215 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:49.998219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:49.998288 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:49.998422 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:52:49.999231 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.000532 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.003843 (+ 3311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.005049 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.005256 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:50.005361 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:50.005953 (+ 592us) server_negotiation.cc:299] Negotiation successful
0924 12:52:50.006185 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260924 12:52:50.006718 15851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebc8ed72db2441d5a92c8d866c6eeb2e" candidate_uuid: "b11da79d4d4948fbadb142c2351211ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a22b2590edb44cfc898120e7d53d43bd" is_pre_election: true
I20260924 12:52:50.007321 15851 raft_consensus.cc:2454] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b11da79d4d4948fbadb142c2351211ee in term 0.
I20260924 12:52:50.008186 15918 leader_election.cc:302] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a22b2590edb44cfc898120e7d53d43bd, b11da79d4d4948fbadb142c2351211ee; no voters:
I20260924 12:52:50.008765 16055 raft_consensus.cc:2781] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:52:50.008937 16055 raft_consensus.cc:482] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:52:50.009075 16055 raft_consensus.cc:3037] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:50.009486 15718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebc8ed72db2441d5a92c8d866c6eeb2e" candidate_uuid: "b11da79d4d4948fbadb142c2351211ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "867c25de6b674ed9a435915c6f1c4b34" is_pre_election: true
I20260924 12:52:50.010020 15718 raft_consensus.cc:2454] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b11da79d4d4948fbadb142c2351211ee in term 0.
I20260924 12:52:50.011920 16055 raft_consensus.cc:504] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11da79d4d4948fbadb142c2351211ee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45011 } } peers { permanent_uuid: "867c25de6b674ed9a435915c6f1c4b34" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38845 } } peers { permanent_uuid: "a22b2590edb44cfc898120e7d53d43bd" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43591 } }
I20260924 12:52:50.012818 16055 leader_election.cc:288] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [CANDIDATE]: Term 1 election: Requested vote from peers 867c25de6b674ed9a435915c6f1c4b34 (127.11.49.65:38845), a22b2590edb44cfc898120e7d53d43bd (127.11.49.66:43591)
I20260924 12:52:50.013414 15718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebc8ed72db2441d5a92c8d866c6eeb2e" candidate_uuid: "b11da79d4d4948fbadb142c2351211ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "867c25de6b674ed9a435915c6f1c4b34"
I20260924 12:52:50.013636 15718 raft_consensus.cc:3037] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:50.013741 15851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebc8ed72db2441d5a92c8d866c6eeb2e" candidate_uuid: "b11da79d4d4948fbadb142c2351211ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a22b2590edb44cfc898120e7d53d43bd"
I20260924 12:52:50.014036 15851 raft_consensus.cc:3037] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:50.016114 15718 raft_consensus.cc:2454] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b11da79d4d4948fbadb142c2351211ee in term 1.
I20260924 12:52:50.016811 15920 leader_election.cc:302] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 867c25de6b674ed9a435915c6f1c4b34, b11da79d4d4948fbadb142c2351211ee; no voters:
I20260924 12:52:50.017073 15851 raft_consensus.cc:2454] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b11da79d4d4948fbadb142c2351211ee in term 1.
I20260924 12:52:50.017275 16055 raft_consensus.cc:2781] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:50.017891 16055 raft_consensus.cc:686] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 1 LEADER]: Becoming Leader. State: Replica: b11da79d4d4948fbadb142c2351211ee, State: Running, Role: LEADER
I20260924 12:52:50.018544 16055 consensus_queue.cc:237] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11da79d4d4948fbadb142c2351211ee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45011 } } peers { permanent_uuid: "867c25de6b674ed9a435915c6f1c4b34" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38845 } } peers { permanent_uuid: "a22b2590edb44cfc898120e7d53d43bd" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43591 } }
I20260924 12:52:50.024430 15575 catalog_manager.cc:5495] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee reported cstate change: term changed from 0 to 1, leader changed from <none> to b11da79d4d4948fbadb142c2351211ee (127.11.49.67). New cstate: current_term: 1 leader_uuid: "b11da79d4d4948fbadb142c2351211ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11da79d4d4948fbadb142c2351211ee" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "867c25de6b674ed9a435915c6f1c4b34" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a22b2590edb44cfc898120e7d53d43bd" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43591 } health_report { overall_health: UNKNOWN } } }
I20260924 12:52:50.061970 16044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:50.056126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47368 (local address 127.11.49.67:45011)
0924 12:52:50.056419 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:50.056424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:50.056440 (+ 16us) server_negotiation.cc:407] Connection header received
0924 12:52:50.056533 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:50.056537 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:50.056612 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:50.056772 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:52:50.057147 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.057876 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.059380 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.059789 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.059956 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:50.060511 (+ 555us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:52:50.061054 (+ 543us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:52:50.061237 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:50.061442 (+ 205us) server_negotiation.cc:299] Negotiation successful
0924 12:52:50.061605 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260924 12:52:50.066447 16030 tablet.cc:2369] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:52:50.070399 15764 tablet.cc:2369] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:52:50.073344 15718 raft_consensus.cc:1261] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34 [term 1 FOLLOWER]: Refusing update from remote peer b11da79d4d4948fbadb142c2351211ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:50.073470 15851 raft_consensus.cc:1261] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd [term 1 FOLLOWER]: Refusing update from remote peer b11da79d4d4948fbadb142c2351211ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:50.074679 16055 consensus_queue.cc:1035] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a22b2590edb44cfc898120e7d53d43bd" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:50.075129 16058 consensus_queue.cc:1035] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "867c25de6b674ed9a435915c6f1c4b34" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:50.088876 16061 mvcc.cc:205] Tried to move back new op lower bound from 7332881899806248960 to 7332881899599577088. Current Snapshot: MvccSnapshot[applied={T|T < 7332881899806248960}]
I20260924 12:52:50.089736 16063 mvcc.cc:205] Tried to move back new op lower bound from 7332881899806248960 to 7332881899599577088. Current Snapshot: MvccSnapshot[applied={T|T < 7332881899806248960}]
I20260924 12:52:50.111073 15574 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:50.111485 15574 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:50.116569 15574 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2e2e74b429df40878f42d943dc10f0e0: Sending DeleteTablet for 3 replicas of tablet ebc8ed72db2441d5a92c8d866c6eeb2e
I20260924 12:52:50.118113 15964 tablet_service.cc:1514] Processing DeleteTablet for tablet ebc8ed72db2441d5a92c8d866c6eeb2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:50 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:47358
I20260924 12:52:50.118264 15698 tablet_service.cc:1514] Processing DeleteTablet for tablet ebc8ed72db2441d5a92c8d866c6eeb2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:50 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:36054
I20260924 12:52:50.118993 15831 tablet_service.cc:1514] Processing DeleteTablet for tablet ebc8ed72db2441d5a92c8d866c6eeb2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:50 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:58112
I20260924 12:52:50.123565 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 15636
I20260924 12:52:50.142627 16072 tablet_replica.cc:330] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd: stopping tablet replica
I20260924 12:52:50.143369 16072 raft_consensus.cc:2229] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:50.143983 16072 raft_consensus.cc:2258] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:50.146533 16072 ts_tablet_manager.cc:1905] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:50.148840 16070 tablet_replica.cc:330] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: stopping tablet replica
I20260924 12:52:50.149374 16070 raft_consensus.cc:2229] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:52:50.150243 16070 raft_consensus.cc:2258] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:50.151218 16071 tablet_replica.cc:330] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: stopping tablet replica
I20260924 12:52:50.151662 16071 raft_consensus.cc:2229] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:50.152201 16071 raft_consensus.cc:2258] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34 [term 1 FOLLOWER]: Raft consensus is shut down!
Sep 24 12:52:50 dist-test-slave-m9hg krb5kdc[15531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:52:50.154614 16071 ts_tablet_manager.cc:1905] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:50.159093 16072 ts_tablet_manager.cc:1918] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:52:50.159536 16072 log.cc:1196] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/ebc8ed72db2441d5a92c8d866c6eeb2e
I20260924 12:52:50.160624 16072 ts_tablet_manager.cc:1939] T ebc8ed72db2441d5a92c8d866c6eeb2e P a22b2590edb44cfc898120e7d53d43bd: Deleting consensus metadata
I20260924 12:52:50.163285 15560 catalog_manager.cc:4841] TS a22b2590edb44cfc898120e7d53d43bd (127.11.49.66:43591): tablet ebc8ed72db2441d5a92c8d866c6eeb2e (table test-table [id=af5503ea6b0741dcaec965761912db8b]) successfully deleted
I20260924 12:52:50.163486 16071 ts_tablet_manager.cc:1918] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:52:50.163688 16071 log.cc:1196] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/ebc8ed72db2441d5a92c8d866c6eeb2e
I20260924 12:52:50.164377 16071 ts_tablet_manager.cc:1939] T ebc8ed72db2441d5a92c8d866c6eeb2e P 867c25de6b674ed9a435915c6f1c4b34: Deleting consensus metadata
I20260924 12:52:50.165516 16070 ts_tablet_manager.cc:1905] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:50.166514 16046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:50.125988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36056 (local address 127.11.49.65:38845)
0924 12:52:50.126326 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:50.126338 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:50.137201 (+ 10863us) server_negotiation.cc:407] Connection header received
0924 12:52:50.137642 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:50.137654 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:50.137830 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:50.137940 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:50.140677 (+ 2737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.142440 (+ 1763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.145567 (+ 3127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.146629 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.146764 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:50.156256 (+ 9492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:50.156307 (+ 51us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:50.156332 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:50.156404 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:50.161577 (+ 5173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:50.162871 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:50.162883 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:50.162887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:50.163331 (+ 444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:50.163961 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:50.163968 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:50.163972 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:50.164629 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:50.165019 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:50.165703 (+ 684us) server_negotiation.cc:299] Negotiation successful
0924 12:52:50.166066 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260924 12:52:50.166787 15562 catalog_manager.cc:4841] TS 867c25de6b674ed9a435915c6f1c4b34 (127.11.49.65:38845): tablet ebc8ed72db2441d5a92c8d866c6eeb2e (table test-table [id=af5503ea6b0741dcaec965761912db8b]) successfully deleted
I20260924 12:52:50.168566 15758 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:50.175776 16070 ts_tablet_manager.cc:1918] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:52:50.176060 16070 log.cc:1196] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/ebc8ed72db2441d5a92c8d866c6eeb2e
I20260924 12:52:50.176831 16070 ts_tablet_manager.cc:1939] T ebc8ed72db2441d5a92c8d866c6eeb2e P b11da79d4d4948fbadb142c2351211ee: Deleting consensus metadata
I20260924 12:52:50.179461 15561 catalog_manager.cc:4841] TS b11da79d4d4948fbadb142c2351211ee (127.11.49.67:45011): tablet ebc8ed72db2441d5a92c8d866c6eeb2e (table test-table [id=af5503ea6b0741dcaec965761912db8b]) successfully deleted
I20260924 12:52:50.273169 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 15636
I20260924 12:52:50.298799 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 15769
Sep 24 12:52:50 dist-test-slave-m9hg krb5kdc[15531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:52:50.317700 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:50.299779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58114 (local address 127.11.49.66:43591)
0924 12:52:50.300040 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:50.300047 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:50.300071 (+ 24us) server_negotiation.cc:407] Connection header received
0924 12:52:50.300233 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:50.300239 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:50.300402 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:50.300526 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:50.301935 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.302789 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.304340 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.304786 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.304952 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:50.310086 (+ 5134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:50.310110 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:50.310131 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:50.310189 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:50.313952 (+ 3763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:50.314990 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:50.315001 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:50.315004 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:50.315181 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:50.315652 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:50.315659 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:50.315663 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:50.316144 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:50.316572 (+ 428us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:50.316950 (+ 378us) server_negotiation.cc:299] Negotiation successful
0924 12:52:50.317239 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260924 12:52:50.318536 15891 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:50.421371 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 15769
I20260924 12:52:50.442102 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 15902
Sep 24 12:52:50 dist-test-slave-m9hg krb5kdc[15531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:52:50.462103 16044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:50.443195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47382 (local address 127.11.49.67:45011)
0924 12:52:50.443425 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:50.443432 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:50.443461 (+ 29us) server_negotiation.cc:407] Connection header received
0924 12:52:50.443632 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:50.443642 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:50.443718 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:50.443855 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:50.445334 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.446269 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.447667 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:50.448216 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:50.448519 (+ 303us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:50.453975 (+ 5456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:50.453997 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:50.454018 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:52:50.454107 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:50.458121 (+ 4014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:50.459150 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:50.459159 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:50.459167 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:50.459412 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:52:50.459883 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:52:50.459889 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:52:50.459893 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:52:50.460553 (+ 660us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:50.460988 (+ 435us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:50.461312 (+ 324us) server_negotiation.cc:299] Negotiation successful
0924 12:52:50.461622 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260924 12:52:50.463145 16024 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:50.608248 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 15902
I20260924 12:52:50.629623 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 15544
I20260924 12:52:50.631239 15605 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:50.755705 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 15544
2026-09-24T12:52:50Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4797 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-24T12:52:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:50Z Disabled control of system clock
I20260924 12:52:50.839258 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:46549
--webserver_interface=127.11.49.126
--webserver_port=0
--builtin_ntp_servers=127.11.49.84:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:46549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260924 12:52:51.259532 16081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:51.259949 16081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:51.260051 16081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:51.268837 16081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:51.269008 16081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:51.269052 16081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:51.269120 16081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:51.269172 16081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:52:51.280485 16081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:46549
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:46549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:51.282222 16081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:51.284574 16081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:51.300182 16086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:51.300390 16087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:51.300379 16089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:51.301653 16081 server_base.cc:1034] running on GCE node
I20260924 12:52:51.302696 16081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:51.304687 16081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:51.305999 16081 hybrid_clock.cc:648] HybridClock initialized: now 1790254371305903 us; error 44 us; skew 500 ppm
I20260924 12:52:51.306489 16081 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:52:51.309820 16081 webserver.cc:460] Webserver started at http://127.11.49.126:37219/ using document root <none> and password file <none>
I20260924 12:52:51.310765 16081 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:51.310879 16081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:51.311228 16081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:51.315112 16081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "3e8689205a28411cba9f134db971e249"
format_stamp: "Formatted at 2026-09-24 12:52:51 on dist-test-slave-m9hg"
server_key: "31d29fd52dbc71f1a1113017c59fd8b4"
server_key_iv: "231f2970a27253607d06d85a44953c0a"
server_key_version: "encryptionkey@0"
I20260924 12:52:51.316352 16081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "3e8689205a28411cba9f134db971e249"
format_stamp: "Formatted at 2026-09-24 12:52:51 on dist-test-slave-m9hg"
server_key: "31d29fd52dbc71f1a1113017c59fd8b4"
server_key_iv: "231f2970a27253607d06d85a44953c0a"
server_key_version: "encryptionkey@0"
I20260924 12:52:51.323657 16081 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260924 12:52:51.328878 16095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:51.330873 16081 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260924 12:52:51.331116 16081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "3e8689205a28411cba9f134db971e249"
format_stamp: "Formatted at 2026-09-24 12:52:51 on dist-test-slave-m9hg"
server_key: "31d29fd52dbc71f1a1113017c59fd8b4"
server_key_iv: "231f2970a27253607d06d85a44953c0a"
server_key_version: "encryptionkey@0"
I20260924 12:52:51.331379 16081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:51.339295 16081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:51.340647 16081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:51.341040 16081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:51.364086 16081 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:46549
I20260924 12:52:51.364100 16146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:46549 every 8 connection(s)
I20260924 12:52:51.365942 16081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:51.369019 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 16081
I20260924 12:52:51.369254 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:51.369988 11461 external_mini_cluster.cc:1428] Setting key 1bf8b5ff07965bdb8b3b1a3defb5f29e
I20260924 12:52:51.370800 16147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:51.379596 16150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:51.372452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40226 (local address 127.11.49.126:46549)
0924 12:52:51.373615 (+ 1163us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:51.373627 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:51.373676 (+ 49us) server_negotiation.cc:407] Connection header received
0924 12:52:51.375359 (+ 1683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:51.375381 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:51.375855 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:51.376227 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:51.377772 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:51.377779 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:51.377793 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:51.377815 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:51.377937 (+ 122us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:51.377958 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:51.378168 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:51.378284 (+ 116us) server_negotiation.cc:299] Negotiation successful
0924 12:52:51.378591 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":446,"threads_started":1}
I20260924 12:52:51.387950 16147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249: Bootstrap starting.
I20260924 12:52:51.392215 16147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:51.393621 16147 log.cc:824] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:51.397920 16147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249: No bootstrap required, opened a new log
I20260924 12:52:51.407164 16147 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8689205a28411cba9f134db971e249" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46549 } }
I20260924 12:52:51.407732 16147 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:51.407853 16147 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8689205a28411cba9f134db971e249, State: Initialized, Role: FOLLOWER
I20260924 12:52:51.408653 16147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8689205a28411cba9f134db971e249" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46549 } }
I20260924 12:52:51.408944 16147 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:51.409106 16147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:51.409309 16147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:51.411809 16147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8689205a28411cba9f134db971e249" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46549 } }
I20260924 12:52:51.412580 16147 leader_election.cc:302] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8689205a28411cba9f134db971e249; no voters:
I20260924 12:52:51.413339 16147 leader_election.cc:288] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:51.413596 16152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:51.415010 16152 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8689205a28411cba9f134db971e249, State: Running, Role: LEADER
I20260924 12:52:51.415695 16152 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8689205a28411cba9f134db971e249" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46549 } }
I20260924 12:52:51.416258 16147 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:51.419063 16153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e8689205a28411cba9f134db971e249" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8689205a28411cba9f134db971e249" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46549 } } }
I20260924 12:52:51.419548 16153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:51.419344 16154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e8689205a28411cba9f134db971e249. Latest consensus state: current_term: 1 leader_uuid: "3e8689205a28411cba9f134db971e249" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8689205a28411cba9f134db971e249" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46549 } } }
I20260924 12:52:51.419652 16154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:51.420735 16160 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:51.426890 16160 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:51.438930 16160 catalog_manager.cc:1347] Generated new cluster ID: 47087190983847b09070f92707e80de6
I20260924 12:52:51.439071 16160 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:51.469422 16160 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:51.469941 16160 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:51.481058 16160 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249: Generated new TSK 0
I20260924 12:52:51.482532 16160 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:52:51.502017 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46549
--builtin_ntp_servers=127.11.49.84:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260924 12:52:51.871914 16171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:51.872426 16171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:51.872558 16171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:51.881351 16171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:51.881507 16171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:51.881634 16171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:52:51.892035 16171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:51.893790 16171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:51.896099 16171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:51.913022 16179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:51.913095 16176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:51.913095 16177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:51.915099 16171 server_base.cc:1034] running on GCE node
I20260924 12:52:51.916069 16171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:51.917629 16171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:51.918982 16171 hybrid_clock.cc:648] HybridClock initialized: now 1790254371918911 us; error 80 us; skew 500 ppm
I20260924 12:52:51.919376 16171 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:52:51.922644 16171 webserver.cc:460] Webserver started at http://127.11.49.65:41625/ using document root <none> and password file <none>
I20260924 12:52:51.923619 16171 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:51.923738 16171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:51.924149 16171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:51.928242 16171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "c9228b721ed64ef4ba610318025ed4ef"
format_stamp: "Formatted at 2026-09-24 12:52:51 on dist-test-slave-m9hg"
server_key: "07a825606690e9bf6712e0acc908f749"
server_key_iv: "7b1cd926db291d0fed17817891ede718"
server_key_version: "encryptionkey@0"
I20260924 12:52:51.929498 16171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "c9228b721ed64ef4ba610318025ed4ef"
format_stamp: "Formatted at 2026-09-24 12:52:51 on dist-test-slave-m9hg"
server_key: "07a825606690e9bf6712e0acc908f749"
server_key_iv: "7b1cd926db291d0fed17817891ede718"
server_key_version: "encryptionkey@0"
I20260924 12:52:51.937093 16171 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260924 12:52:51.942379 16185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:51.944128 16171 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260924 12:52:51.944384 16171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "c9228b721ed64ef4ba610318025ed4ef"
format_stamp: "Formatted at 2026-09-24 12:52:51 on dist-test-slave-m9hg"
server_key: "07a825606690e9bf6712e0acc908f749"
server_key_iv: "7b1cd926db291d0fed17817891ede718"
server_key_version: "encryptionkey@0"
I20260924 12:52:51.944684 16171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:51.950872 16171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:51.951750 16171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:51.952059 16171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:51.953209 16171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:51.954833 16171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:51.954926 16171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:51.955086 16171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:51.955183 16171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:51.995012 16171 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:33827
I20260924 12:52:51.995066 16297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:33827 every 8 connection(s)
I20260924 12:52:51.996845 16171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:52:52.001842 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 16171
I20260924 12:52:52.002100 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:52:52.002825 11461 external_mini_cluster.cc:1428] Setting key 2d820f4a4cbac3954d38ca86e322dd63
I20260924 12:52:52.006230 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46549
--builtin_ntp_servers=127.11.49.84:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260924 12:52:52.007412 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:51.999921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:40983 (local address 127.11.49.126:46549)
0924 12:52:52.000446 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:52.000450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:52.003531 (+ 3081us) server_negotiation.cc:407] Connection header received
0924 12:52:52.004171 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:52.004177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:52.004258 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:52.004430 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:52.006194 (+ 1764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:52.006202 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:52.006209 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:52.006233 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:52.006289 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:52.006308 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:52.006472 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:52.006930 (+ 458us) server_negotiation.cc:299] Negotiation successful
0924 12:52:52.007005 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":276,"threads_started":1}
I20260924 12:52:52.008785 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:52.000735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46549 (local address 127.11.49.65:40983)
0924 12:52:52.001881 (+ 1146us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:52.001934 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:52.003874 (+ 1940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:52.004690 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:52.004699 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:52.004804 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:52.005763 (+ 959us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:52:52.005766 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:52.005824 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:52:52.005965 (+ 141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:52.006638 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:52.006650 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:52.006660 (+ 10us) client_negotiation.cc:769] Sending connection context
0924 12:52:52.006999 (+ 339us) client_negotiation.cc:240] Negotiation successful
0924 12:52:52.007307 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":342,"threads_started":1}
I20260924 12:52:52.011000 16298 heartbeater.cc:347] Connected to a master server at 127.11.49.126:46549
I20260924 12:52:52.011412 16298 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:52.012101 16298 heartbeater.cc:511] Master 127.11.49.126:46549 requested a full tablet report, sending...
I20260924 12:52:52.014565 16112 ts_manager.cc:194] Registered new tserver with Master: c9228b721ed64ef4ba610318025ed4ef (127.11.49.65:33827)
W20260924 12:52:52.426689 16302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:52.427081 16302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:52.427246 16302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:52.435856 16302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:52.436009 16302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:52.436234 16302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:52:52.447206 16302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:52.449123 16302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:52.451560 16302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:52.468839 16310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:52.468896 16307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:52.468896 16308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:52.470394 16302 server_base.cc:1034] running on GCE node
I20260924 12:52:52.471300 16302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:52.472710 16302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:52.474000 16302 hybrid_clock.cc:648] HybridClock initialized: now 1790254372473913 us; error 70 us; skew 500 ppm
I20260924 12:52:52.474442 16302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:52:52.477708 16302 webserver.cc:460] Webserver started at http://127.11.49.66:38439/ using document root <none> and password file <none>
I20260924 12:52:52.478698 16302 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:52.478859 16302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:52.479278 16302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:52.483265 16302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "cb172c451a1e460594df0084bc344b04"
format_stamp: "Formatted at 2026-09-24 12:52:52 on dist-test-slave-m9hg"
server_key: "0579f6fb6af0731791162fc38560f536"
server_key_iv: "420e1dacb654c94a19f751b4a123a51a"
server_key_version: "encryptionkey@0"
I20260924 12:52:52.484509 16302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "cb172c451a1e460594df0084bc344b04"
format_stamp: "Formatted at 2026-09-24 12:52:52 on dist-test-slave-m9hg"
server_key: "0579f6fb6af0731791162fc38560f536"
server_key_iv: "420e1dacb654c94a19f751b4a123a51a"
server_key_version: "encryptionkey@0"
I20260924 12:52:52.491766 16302 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.004s
I20260924 12:52:52.497040 16316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:52.498979 16302 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:52:52.499276 16302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "cb172c451a1e460594df0084bc344b04"
format_stamp: "Formatted at 2026-09-24 12:52:52 on dist-test-slave-m9hg"
server_key: "0579f6fb6af0731791162fc38560f536"
server_key_iv: "420e1dacb654c94a19f751b4a123a51a"
server_key_version: "encryptionkey@0"
I20260924 12:52:52.499608 16302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:52.507400 16302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:52.508620 16302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:52.509027 16302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:52.510407 16302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:52.512373 16302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:52.512512 16302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260924 12:52:52.512665 16302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:52.512760 16302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:52.554360 16302 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:40081
I20260924 12:52:52.554438 16428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:40081 every 8 connection(s)
I20260924 12:52:52.556232 16302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:52:52.564826 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 16302
I20260924 12:52:52.565101 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:52:52.565747 11461 external_mini_cluster.cc:1428] Setting key 2f53dcd140da593dbb3c05e9af4adf1c
I20260924 12:52:52.566879 16431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:52.559649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:47147 (local address 127.11.49.126:46549)
0924 12:52:52.560184 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:52.560190 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:52.561938 (+ 1748us) server_negotiation.cc:407] Connection header received
0924 12:52:52.563960 (+ 2022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:52.563966 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:52.564039 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:52.564173 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:52.565979 (+ 1806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:52.565984 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:52.565988 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:52.566007 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:52.566049 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:52.566061 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:52.566204 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:52.566403 (+ 199us) server_negotiation.cc:299] Negotiation successful
0924 12:52:52.566473 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":313,"threads_started":1}
I20260924 12:52:52.567976 16432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:52.560454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46549 (local address 127.11.49.66:47147)
0924 12:52:52.561722 (+ 1268us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:52.561782 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:52.563639 (+ 1857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:52.564500 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:52.564510 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:52.564624 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:52.565613 (+ 989us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:52:52.565616 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:52.565658 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:52:52.565754 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:52.566168 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:52.566181 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:52.566188 (+ 7us) client_negotiation.cc:769] Sending connection context
0924 12:52:52.566505 (+ 317us) client_negotiation.cc:240] Negotiation successful
0924 12:52:52.566791 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":365,"threads_started":1}
I20260924 12:52:52.569411 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46549
--builtin_ntp_servers=127.11.49.84:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260924 12:52:52.569525 16429 heartbeater.cc:347] Connected to a master server at 127.11.49.126:46549
I20260924 12:52:52.569880 16429 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:52.570526 16429 heartbeater.cc:511] Master 127.11.49.126:46549 requested a full tablet report, sending...
I20260924 12:52:52.572198 16112 ts_manager.cc:194] Registered new tserver with Master: cb172c451a1e460594df0084bc344b04 (127.11.49.66:40081)
W20260924 12:52:52.998725 16433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:52.999176 16433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:52.999361 16433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:53.008298 16433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:53.008496 16433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:53.008699 16433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:52:53.017817 16298 heartbeater.cc:503] Master 127.11.49.126:46549 was elected leader, sending a full tablet report...
I20260924 12:52:53.020354 16433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:53.022156 16433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:53.024567 16433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:53.042040 16441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:53.041937 16438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:53.042136 16439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:53.042869 16433 server_base.cc:1034] running on GCE node
I20260924 12:52:53.043530 16433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:53.044752 16433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:53.045997 16433 hybrid_clock.cc:648] HybridClock initialized: now 1790254373045940 us; error 62 us; skew 500 ppm
I20260924 12:52:53.046375 16433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:52:53.049640 16433 webserver.cc:460] Webserver started at http://127.11.49.67:36309/ using document root <none> and password file <none>
I20260924 12:52:53.050494 16433 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:53.050593 16433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:53.050993 16433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:53.054318 16433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "8494fa38170543efb536d9fe4ba2a7e8"
format_stamp: "Formatted at 2026-09-24 12:52:53 on dist-test-slave-m9hg"
server_key: "d066626382c017ea1b89904c2ead5797"
server_key_iv: "d44ec59adb0aaf838bf972529c59501b"
server_key_version: "encryptionkey@0"
I20260924 12:52:53.055162 16433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "8494fa38170543efb536d9fe4ba2a7e8"
format_stamp: "Formatted at 2026-09-24 12:52:53 on dist-test-slave-m9hg"
server_key: "d066626382c017ea1b89904c2ead5797"
server_key_iv: "d44ec59adb0aaf838bf972529c59501b"
server_key_version: "encryptionkey@0"
I20260924 12:52:53.061343 16433 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260924 12:52:53.066012 16447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:53.068063 16433 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260924 12:52:53.068325 16433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "8494fa38170543efb536d9fe4ba2a7e8"
format_stamp: "Formatted at 2026-09-24 12:52:53 on dist-test-slave-m9hg"
server_key: "d066626382c017ea1b89904c2ead5797"
server_key_iv: "d44ec59adb0aaf838bf972529c59501b"
server_key_version: "encryptionkey@0"
I20260924 12:52:53.068578 16433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:53.074803 16433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:53.075657 16433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:53.075945 16433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:53.077144 16433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:52:53.078871 16433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:52:53.078991 16433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:53.079118 16433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:52:53.079211 16433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:53.119001 16433 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:33173
I20260924 12:52:53.119052 16559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:33173 every 8 connection(s)
I20260924 12:52:53.120867 16433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:52:53.130308 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 16433
I20260924 12:52:53.130579 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:52:53.131312 11461 external_mini_cluster.cc:1428] Setting key fa4c4849a8ea3dc031a3ba6604877dbd
I20260924 12:52:53.132181 16562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.124744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:38147 (local address 127.11.49.126:46549)
0924 12:52:53.125384 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:53.125392 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:53.127173 (+ 1781us) server_negotiation.cc:407] Connection header received
0924 12:52:53.129021 (+ 1848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:53.129026 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:53.129108 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:53.129260 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:53.131029 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:53.131038 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:53.131043 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:53.131077 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:53.131156 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:53.131178 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:53.131392 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:53.131623 (+ 231us) server_negotiation.cc:299] Negotiation successful
0924 12:52:53.131720 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":303,"threads_started":1}
I20260924 12:52:53.133190 16563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.125707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46549 (local address 127.11.49.67:38147)
0924 12:52:53.126962 (+ 1255us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.127007 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:53.128691 (+ 1684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:53.129486 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:53.129495 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:53.129596 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:53.130583 (+ 987us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:52:53.130586 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:53.130626 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:52:53.130757 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:53.131322 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:53.131330 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:53.131336 (+ 6us) client_negotiation.cc:769] Sending connection context
0924 12:52:53.131647 (+ 311us) client_negotiation.cc:240] Negotiation successful
0924 12:52:53.131901 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":358,"threads_started":1}
I20260924 12:52:53.135270 16560 heartbeater.cc:347] Connected to a master server at 127.11.49.126:46549
I20260924 12:52:53.135679 16560 heartbeater.cc:464] Registering TS with master...
I20260924 12:52:53.136376 16560 heartbeater.cc:511] Master 127.11.49.126:46549 requested a full tablet report, sending...
I20260924 12:52:53.138247 16111 ts_manager.cc:194] Registered new tserver with Master: 8494fa38170543efb536d9fe4ba2a7e8 (127.11.49.67:33173)
I20260924 12:52:53.149391 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:52:53.157747 16562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.154841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40240 (local address 127.11.49.126:46549)
0924 12:52:53.155071 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:53.155078 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:53.155658 (+ 580us) server_negotiation.cc:407] Connection header received
0924 12:52:53.155806 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:53.155811 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:53.155910 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:53.156065 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:53.157134 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:53.157139 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:53.157143 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:53.157161 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:53.157200 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:53.157214 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:53.157341 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:53.157434 (+ 93us) server_negotiation.cc:299] Negotiation successful
0924 12:52:53.157499 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260924 12:52:53.163070 16111 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40240:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:52:53.170277 16111 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:52:53.202716 16578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.188324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37582 (local address 127.11.49.67:33173)
0924 12:52:53.195433 (+ 7109us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:53.195447 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:53.198561 (+ 3114us) server_negotiation.cc:407] Connection header received
0924 12:52:53.198715 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:53.198721 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:53.199015 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:53.199192 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:53.201693 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:53.201704 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:53.201717 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:53.201740 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:53.201793 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:53.201811 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:53.201951 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:53.202182 (+ 231us) server_negotiation.cc:299] Negotiation successful
0924 12:52:53.202305 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6869,"thread_start_us":6672,"threads_started":1}
I20260924 12:52:53.202716 16574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.186253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38748 (local address 127.11.49.65:33827)
0924 12:52:53.197519 (+ 11266us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:53.197532 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:53.197587 (+ 55us) server_negotiation.cc:407] Connection header received
0924 12:52:53.198284 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:53.198296 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:53.198627 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:53.198796 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:53.201490 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:53.201503 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:53.201520 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:53.201553 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:53.201641 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:53.201666 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:53.201876 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:53.202183 (+ 307us) server_negotiation.cc:299] Negotiation successful
0924 12:52:53.202302 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11002,"thread_start_us":11562,"threads_started":1}
I20260924 12:52:53.203540 16573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.186482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:40081 (local address 127.0.0.1:41426)
0924 12:52:53.198156 (+ 11674us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.198183 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:53.198363 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:53.200684 (+ 2321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:53.200692 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:53.200716 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:53.201653 (+ 937us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:52:53.201656 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:53.201673 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:52:53.201713 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:53.202280 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:53.202286 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:53.202295 (+ 9us) client_negotiation.cc:769] Sending connection context
0924 12:52:53.202454 (+ 159us) client_negotiation.cc:240] Negotiation successful
0924 12:52:53.202570 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11488,"thread_start_us":11695,"threads_started":1}
I20260924 12:52:53.203663 16577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.188130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41426 (local address 127.11.49.66:40081)
0924 12:52:53.199383 (+ 11253us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:53.199391 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:53.199418 (+ 27us) server_negotiation.cc:407] Connection header received
0924 12:52:53.199479 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:53.199485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:53.199672 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:53.199819 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:53.201930 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:53.201941 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:53.201957 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:53.201993 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:53.202064 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:53.202087 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:53.202226 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:53.203210 (+ 984us) server_negotiation.cc:299] Negotiation successful
0924 12:52:53.203318 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11071,"thread_start_us":10931,"threads_started":1}
I20260924 12:52:53.203962 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.185869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33827 (local address 127.0.0.1:38748)
0924 12:52:53.197324 (+ 11455us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.197401 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:53.197680 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:53.199523 (+ 1843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:53.199535 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:53.199725 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:53.201022 (+ 1297us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:52:53.201026 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:53.201066 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:52:53.201169 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:53.201949 (+ 780us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:53.201968 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:53.201980 (+ 12us) client_negotiation.cc:769] Sending connection context
0924 12:52:53.203187 (+ 1207us) client_negotiation.cc:240] Negotiation successful
0924 12:52:53.203270 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10232,"thread_start_us":11926,"threads_started":1}
I20260924 12:52:53.203579 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.187109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:33173 (local address 127.0.0.1:37582)
0924 12:52:53.198456 (+ 11347us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.198474 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:53.198565 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:53.200250 (+ 1685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:53.200258 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:53.200316 (+ 58us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:53.201403 (+ 1087us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:52:53.201406 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:53.201431 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:52:53.201491 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:53.202040 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:53.202044 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:53.202048 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 12:52:53.202797 (+ 749us) client_negotiation.cc:240] Negotiation successful
0924 12:52:53.202851 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11220,"thread_start_us":8714,"threads_started":1}
I20260924 12:52:53.208374 16495 tablet_service.cc:1467] Processing CreateTablet for tablet e1a298f257c1459cabb0077d487eb15a (DEFAULT_TABLE table=test-table [id=a56aff830378412facdc7eafa66ca61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:53.208793 16364 tablet_service.cc:1467] Processing CreateTablet for tablet e1a298f257c1459cabb0077d487eb15a (DEFAULT_TABLE table=test-table [id=a56aff830378412facdc7eafa66ca61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:53.208793 16233 tablet_service.cc:1467] Processing CreateTablet for tablet e1a298f257c1459cabb0077d487eb15a (DEFAULT_TABLE table=test-table [id=a56aff830378412facdc7eafa66ca61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:52:53.209874 16495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1a298f257c1459cabb0077d487eb15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:53.210469 16233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1a298f257c1459cabb0077d487eb15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:53.210469 16364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1a298f257c1459cabb0077d487eb15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:53.224112 16579 tablet_bootstrap.cc:492] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: Bootstrap starting.
I20260924 12:52:53.227802 16579 tablet_bootstrap.cc:654] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:53.229027 16579 log.cc:824] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:53.233549 16581 tablet_bootstrap.cc:492] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef: Bootstrap starting.
I20260924 12:52:53.236116 16580 tablet_bootstrap.cc:492] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: Bootstrap starting.
I20260924 12:52:53.240036 16579 tablet_bootstrap.cc:492] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: No bootstrap required, opened a new log
I20260924 12:52:53.240146 16580 tablet_bootstrap.cc:654] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:53.240554 16579 ts_tablet_manager.cc:1397] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.008s
I20260924 12:52:53.241590 16581 tablet_bootstrap.cc:654] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:53.241575 16580 log.cc:824] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:53.243257 16581 log.cc:824] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:53.245585 16580 tablet_bootstrap.cc:492] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: No bootstrap required, opened a new log
I20260924 12:52:53.245904 16580 ts_tablet_manager.cc:1397] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260924 12:52:53.246783 16581 tablet_bootstrap.cc:492] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef: No bootstrap required, opened a new log
I20260924 12:52:53.247138 16581 ts_tablet_manager.cc:1397] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.000s
I20260924 12:52:53.251092 16579 raft_consensus.cc:348] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9228b721ed64ef4ba610318025ed4ef" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33827 } } peers { permanent_uuid: "cb172c451a1e460594df0084bc344b04" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 40081 } } peers { permanent_uuid: "8494fa38170543efb536d9fe4ba2a7e8" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 33173 } }
I20260924 12:52:53.251811 16579 raft_consensus.cc:374] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:53.251971 16579 raft_consensus.cc:729] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8494fa38170543efb536d9fe4ba2a7e8, State: Initialized, Role: FOLLOWER
I20260924 12:52:53.252874 16579 consensus_queue.cc:260] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9228b721ed64ef4ba610318025ed4ef" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33827 } } peers { permanent_uuid: "cb172c451a1e460594df0084bc344b04" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 40081 } } peers { permanent_uuid: "8494fa38170543efb536d9fe4ba2a7e8" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 33173 } }
I20260924 12:52:53.254339 16560 heartbeater.cc:503] Master 127.11.49.126:46549 was elected leader, sending a full tablet report...
I20260924 12:52:53.254906 16579 ts_tablet_manager.cc:1428] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260924 12:52:53.257305 16580 raft_consensus.cc:348] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9228b721ed64ef4ba610318025ed4ef" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33827 } } peers { permanent_uuid: "cb172c451a1e460594df0084bc344b04" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 40081 } } peers { permanent_uuid: "8494fa38170543efb536d9fe4ba2a7e8" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 33173 } }
I20260924 12:52:53.257750 16580 raft_consensus.cc:374] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:53.257886 16580 raft_consensus.cc:729] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb172c451a1e460594df0084bc344b04, State: Initialized, Role: FOLLOWER
I20260924 12:52:53.258118 16581 raft_consensus.cc:348] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9228b721ed64ef4ba610318025ed4ef" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33827 } } peers { permanent_uuid: "cb172c451a1e460594df0084bc344b04" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 40081 } } peers { permanent_uuid: "8494fa38170543efb536d9fe4ba2a7e8" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 33173 } }
I20260924 12:52:53.258733 16581 raft_consensus.cc:374] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:53.258553 16580 consensus_queue.cc:260] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9228b721ed64ef4ba610318025ed4ef" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33827 } } peers { permanent_uuid: "cb172c451a1e460594df0084bc344b04" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 40081 } } peers { permanent_uuid: "8494fa38170543efb536d9fe4ba2a7e8" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 33173 } }
I20260924 12:52:53.258858 16581 raft_consensus.cc:729] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9228b721ed64ef4ba610318025ed4ef, State: Initialized, Role: FOLLOWER
I20260924 12:52:53.259786 16429 heartbeater.cc:503] Master 127.11.49.126:46549 was elected leader, sending a full tablet report...
I20260924 12:52:53.259693 16581 consensus_queue.cc:260] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9228b721ed64ef4ba610318025ed4ef" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33827 } } peers { permanent_uuid: "cb172c451a1e460594df0084bc344b04" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 40081 } } peers { permanent_uuid: "8494fa38170543efb536d9fe4ba2a7e8" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 33173 } }
I20260924 12:52:53.260618 16580 ts_tablet_manager.cc:1428] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260924 12:52:53.261982 16581 ts_tablet_manager.cc:1428] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef: Time spent starting tablet: real 0.015s user 0.010s sys 0.006s
W20260924 12:52:53.309185 16430 tablet.cc:2369] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:52:53.359650 16587 raft_consensus.cc:482] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:52:53.360054 16587 raft_consensus.cc:504] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9228b721ed64ef4ba610318025ed4ef" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33827 } } peers { permanent_uuid: "cb172c451a1e460594df0084bc344b04" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 40081 } } peers { permanent_uuid: "8494fa38170543efb536d9fe4ba2a7e8" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 33173 } }
I20260924 12:52:53.362251 16587 leader_election.cc:288] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb172c451a1e460594df0084bc344b04 (127.11.49.66:40081), 8494fa38170543efb536d9fe4ba2a7e8 (127.11.49.67:33173)
I20260924 12:52:53.367940 16578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.363086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:34491 (local address 127.11.49.67:33173)
0924 12:52:53.363366 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:53.363372 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:53.365012 (+ 1640us) server_negotiation.cc:407] Connection header received
0924 12:52:53.365333 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:53.365337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:53.365399 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:53.365507 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:53.367043 (+ 1536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:53.367051 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:53.367056 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:53.367083 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:53.367137 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:53.367154 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:53.367314 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:53.367500 (+ 186us) server_negotiation.cc:299] Negotiation successful
0924 12:52:53.367593 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260924 12:52:53.368029 16577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.362816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:42773 (local address 127.11.49.66:40081)
0924 12:52:53.363046 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:53.363054 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:53.365198 (+ 2144us) server_negotiation.cc:407] Connection header received
0924 12:52:53.365285 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:53.365291 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:53.365364 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:53.365500 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:53.367115 (+ 1615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:53.367120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:53.367124 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:53.367148 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:53.367189 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:53.367203 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:53.367381 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:53.367656 (+ 275us) server_negotiation.cc:299] Negotiation successful
0924 12:52:53.367734 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260924 12:52:53.368140 16588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.362662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:33173 (local address 127.11.49.65:34491)
0924 12:52:53.364821 (+ 2159us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.364850 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:53.365152 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:53.365746 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:53.365752 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:53.365774 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:53.366727 (+ 953us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:52:53.366733 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:53.366757 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:52:53.366815 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:53.367291 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:53.367297 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:53.367302 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 12:52:53.367533 (+ 231us) client_negotiation.cc:240] Negotiation successful
0924 12:52:53.367593 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1953,"thread_start_us":1717,"threads_started":1}
I20260924 12:52:53.368897 16589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.362800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:40081 (local address 127.11.49.65:42773)
0924 12:52:53.365054 (+ 2254us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.365071 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:53.365176 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:53.365573 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:53.365578 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:53.365604 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:52:53.366758 (+ 1154us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:52:53.366761 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:52:53.366771 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:52:53.366814 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:52:53.367425 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:52:53.367432 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:52:53.367439 (+ 7us) client_negotiation.cc:769] Sending connection context
0924 12:52:53.368379 (+ 940us) client_negotiation.cc:240] Negotiation successful
0924 12:52:53.368453 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2137,"thread_start_us":1869,"threads_started":1}
I20260924 12:52:53.369511 16515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1a298f257c1459cabb0077d487eb15a" candidate_uuid: "c9228b721ed64ef4ba610318025ed4ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8494fa38170543efb536d9fe4ba2a7e8" is_pre_election: true
I20260924 12:52:53.370296 16515 raft_consensus.cc:2454] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9228b721ed64ef4ba610318025ed4ef in term 0.
I20260924 12:52:53.370260 16384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1a298f257c1459cabb0077d487eb15a" candidate_uuid: "c9228b721ed64ef4ba610318025ed4ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb172c451a1e460594df0084bc344b04" is_pre_election: true
I20260924 12:52:53.370884 16384 raft_consensus.cc:2454] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9228b721ed64ef4ba610318025ed4ef in term 0.
I20260924 12:52:53.371315 16189 leader_election.cc:302] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8494fa38170543efb536d9fe4ba2a7e8, c9228b721ed64ef4ba610318025ed4ef; no voters:
I20260924 12:52:53.371932 16587 raft_consensus.cc:2781] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:52:53.372212 16587 raft_consensus.cc:482] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:52:53.372366 16587 raft_consensus.cc:3037] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 0 FOLLOWER]: Advancing to term 1
W20260924 12:52:53.373471 16561 tablet.cc:2369] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:52:53.375806 16587 raft_consensus.cc:504] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9228b721ed64ef4ba610318025ed4ef" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33827 } } peers { permanent_uuid: "cb172c451a1e460594df0084bc344b04" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 40081 } } peers { permanent_uuid: "8494fa38170543efb536d9fe4ba2a7e8" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 33173 } }
I20260924 12:52:53.376652 16587 leader_election.cc:288] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [CANDIDATE]: Term 1 election: Requested vote from peers cb172c451a1e460594df0084bc344b04 (127.11.49.66:40081), 8494fa38170543efb536d9fe4ba2a7e8 (127.11.49.67:33173)
I20260924 12:52:53.377524 16515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1a298f257c1459cabb0077d487eb15a" candidate_uuid: "c9228b721ed64ef4ba610318025ed4ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8494fa38170543efb536d9fe4ba2a7e8"
I20260924 12:52:53.377544 16384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1a298f257c1459cabb0077d487eb15a" candidate_uuid: "c9228b721ed64ef4ba610318025ed4ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb172c451a1e460594df0084bc344b04"
I20260924 12:52:53.377815 16384 raft_consensus.cc:3037] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:53.377847 16515 raft_consensus.cc:3037] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:53.380891 16515 raft_consensus.cc:2454] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9228b721ed64ef4ba610318025ed4ef in term 1.
I20260924 12:52:53.381275 16384 raft_consensus.cc:2454] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9228b721ed64ef4ba610318025ed4ef in term 1.
I20260924 12:52:53.381637 16189 leader_election.cc:302] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8494fa38170543efb536d9fe4ba2a7e8, c9228b721ed64ef4ba610318025ed4ef; no voters:
I20260924 12:52:53.382077 16587 raft_consensus.cc:2781] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:53.382714 16587 raft_consensus.cc:686] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 1 LEADER]: Becoming Leader. State: Replica: c9228b721ed64ef4ba610318025ed4ef, State: Running, Role: LEADER
I20260924 12:52:53.383332 16587 consensus_queue.cc:237] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9228b721ed64ef4ba610318025ed4ef" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33827 } } peers { permanent_uuid: "cb172c451a1e460594df0084bc344b04" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 40081 } } peers { permanent_uuid: "8494fa38170543efb536d9fe4ba2a7e8" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 33173 } }
I20260924 12:52:53.388787 16110 catalog_manager.cc:5495] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef reported cstate change: term changed from 0 to 1, leader changed from <none> to c9228b721ed64ef4ba610318025ed4ef (127.11.49.65). New cstate: current_term: 1 leader_uuid: "c9228b721ed64ef4ba610318025ed4ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9228b721ed64ef4ba610318025ed4ef" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb172c451a1e460594df0084bc344b04" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 40081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8494fa38170543efb536d9fe4ba2a7e8" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 33173 } health_report { overall_health: UNKNOWN } } }
I20260924 12:52:53.406997 16574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.404413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38752 (local address 127.11.49.65:33827)
0924 12:52:53.404635 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:53.404643 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:53.404783 (+ 140us) server_negotiation.cc:407] Connection header received
0924 12:52:53.405071 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:53.405075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:53.405179 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:53.405317 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:53.406386 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:53.406395 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:53.406398 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:53.406413 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:53.406450 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:53.406462 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:53.406587 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:53.406673 (+ 86us) server_negotiation.cc:299] Negotiation successful
0924 12:52:53.406733 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260924 12:52:53.416874 16384 raft_consensus.cc:1261] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04 [term 1 FOLLOWER]: Refusing update from remote peer c9228b721ed64ef4ba610318025ed4ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:53.417163 16515 raft_consensus.cc:1261] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8 [term 1 FOLLOWER]: Refusing update from remote peer c9228b721ed64ef4ba610318025ed4ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:52:53.418085 16590 consensus_queue.cc:1035] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb172c451a1e460594df0084bc344b04" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 40081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:53.418632 16587 consensus_queue.cc:1035] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "8494fa38170543efb536d9fe4ba2a7e8" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 33173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:52:53.457526 16110 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:53.457952 16110 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:52:53.463603 16110 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e8689205a28411cba9f134db971e249: Sending DeleteTablet for 3 replicas of tablet e1a298f257c1459cabb0077d487eb15a
I20260924 12:52:53.465322 16495 tablet_service.cc:1514] Processing DeleteTablet for tablet e1a298f257c1459cabb0077d487eb15a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:53 UTC) from {username='slave'} at 127.0.0.1:37582
I20260924 12:52:53.465330 16233 tablet_service.cc:1514] Processing DeleteTablet for tablet e1a298f257c1459cabb0077d487eb15a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:53 UTC) from {username='slave'} at 127.0.0.1:38748
I20260924 12:52:53.465322 16364 tablet_service.cc:1514] Processing DeleteTablet for tablet e1a298f257c1459cabb0077d487eb15a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:52:53 UTC) from {username='slave'} at 127.0.0.1:41426
I20260924 12:52:53.466498 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 16171
I20260924 12:52:53.477986 16603 tablet_replica.cc:330] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: stopping tablet replica
I20260924 12:52:53.478751 16603 raft_consensus.cc:2229] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:53.479624 16603 raft_consensus.cc:2258] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:53.480502 16574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.468657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38766 (local address 127.11.49.65:33827)
0924 12:52:53.468856 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:53.468863 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:53.473955 (+ 5092us) server_negotiation.cc:407] Connection header received
0924 12:52:53.474300 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:53.474306 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:53.474392 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:53.474516 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:53.479480 (+ 4964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:53.479487 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:53.479491 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:53.479516 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:53.479565 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:53.479584 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:53.479701 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:53.480054 (+ 353us) server_negotiation.cc:299] Negotiation successful
0924 12:52:53.480131 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260924 12:52:53.481779 16293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:53.481925 16605 tablet_replica.cc:330] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef: stopping tablet replica
I20260924 12:52:53.482290 16604 tablet_replica.cc:330] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: stopping tablet replica
I20260924 12:52:53.483031 16603 ts_tablet_manager.cc:1905] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:53.483012 16604 raft_consensus.cc:2229] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:52:53.483811 16604 raft_consensus.cc:2258] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:53.487391 16604 ts_tablet_manager.cc:1905] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:53.492143 16603 ts_tablet_manager.cc:1918] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:52:53.492455 16603 log.cc:1196] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/e1a298f257c1459cabb0077d487eb15a
I20260924 12:52:53.493094 16603 ts_tablet_manager.cc:1939] T e1a298f257c1459cabb0077d487eb15a P 8494fa38170543efb536d9fe4ba2a7e8: Deleting consensus metadata
I20260924 12:52:53.494221 16604 ts_tablet_manager.cc:1918] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:52:53.494424 16604 log.cc:1196] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/e1a298f257c1459cabb0077d487eb15a
I20260924 12:52:53.494874 16604 ts_tablet_manager.cc:1939] T e1a298f257c1459cabb0077d487eb15a P cb172c451a1e460594df0084bc344b04: Deleting consensus metadata
I20260924 12:52:53.495847 16099 catalog_manager.cc:4841] TS 8494fa38170543efb536d9fe4ba2a7e8 (127.11.49.67:33173): tablet e1a298f257c1459cabb0077d487eb15a (table test-table [id=a56aff830378412facdc7eafa66ca61e]) successfully deleted
I20260924 12:52:53.496784 16097 catalog_manager.cc:4841] TS cb172c451a1e460594df0084bc344b04 (127.11.49.66:40081): tablet e1a298f257c1459cabb0077d487eb15a (table test-table [id=a56aff830378412facdc7eafa66ca61e]) successfully deleted
I20260924 12:52:53.482529 16605 raft_consensus.cc:2229] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:52:53.592768 16605 raft_consensus.cc:2258] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:52:53.595258 16605 ts_tablet_manager.cc:1905] T e1a298f257c1459cabb0077d487eb15a P c9228b721ed64ef4ba610318025ed4ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:52:53.604466 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 16171
I20260924 12:52:53.623243 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 16302
W20260924 12:52:53.623203 16096 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.49.65:33827 (error 108)
I20260924 12:52:53.625474 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.624954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33827 (local address 127.0.0.1:38772)
0924 12:52:53.625166 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.625300 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260924 12:52:53.625761 16096 catalog_manager.cc:4584] TS c9228b721ed64ef4ba610318025ed4ef (127.11.49.65:33827): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e1a298f257c1459cabb0077d487eb15a: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33827: connect: Connection refused (error 111)
I20260924 12:52:53.627138 16577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.624058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41436 (local address 127.11.49.66:40081)
0924 12:52:53.624610 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:53.624614 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:53.624630 (+ 16us) server_negotiation.cc:407] Connection header received
0924 12:52:53.624683 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:53.624687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:53.624770 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:53.625157 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:53.626294 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:53.626298 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:53.626302 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:53.626319 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:53.626354 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:53.626367 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:53.626493 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:53.626718 (+ 225us) server_negotiation.cc:299] Negotiation successful
0924 12:52:53.626771 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449}
I20260924 12:52:53.628078 16424 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:53.680135 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.679540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33827 (local address 127.0.0.1:38780)
0924 12:52:53.679822 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.679924 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260924 12:52:53.681742 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.681284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33827 (local address 127.0.0.1:38788)
0924 12:52:53.681463 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.681572 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260924 12:52:53.722681 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 16302
I20260924 12:52:53.740574 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 16433
I20260924 12:52:53.743057 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.742200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33827 (local address 127.0.0.1:38792)
0924 12:52:53.742529 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.742666 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185}
I20260924 12:52:53.744635 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.743935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33827 (local address 127.0.0.1:38802)
0924 12:52:53.744132 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.744271 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260924 12:52:53.744851 16578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.741692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37592 (local address 127.11.49.67:33173)
0924 12:52:53.741916 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:53.741922 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:53.742022 (+ 100us) server_negotiation.cc:407] Connection header received
0924 12:52:53.742407 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:53.742416 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:53.742536 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:53.742680 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:53.743852 (+ 1172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:53.743858 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:53.743862 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:53.743883 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:53.743927 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:53.743941 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:53.744139 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:53.744424 (+ 285us) server_negotiation.cc:299] Negotiation successful
0924 12:52:53.744509 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260924 12:52:53.745658 16555 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:53.825603 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.824824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33827 (local address 127.0.0.1:38818)
0924 12:52:53.825192 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.825338 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260924 12:52:53.827001 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:53.826533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33827 (local address 127.0.0.1:38826)
0924 12:52:53.826749 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:53.826846 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260924 12:52:53.840320 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 16433
I20260924 12:52:53.857573 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 16081
I20260924 12:52:53.859066 16142 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:53.972929 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 16081
2026-09-24T12:52:53Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3214 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260924 12:52:54.019187 11461 mini_oidc.cc:152] Starting JWKS server
I20260924 12:52:54.021967 11461 webserver.cc:460] Webserver started at https://127.0.0.1:42057/ using document root <none> and password file <none>
I20260924 12:52:54.022328 11461 mini_oidc.cc:189] Starting OIDC Discovery server
I20260924 12:52:54.023161 11461 webserver.cc:460] Webserver started at http://127.0.0.1:37043/ using document root <none> and password file <none>
2026-09-24T12:52:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:54Z Disabled control of system clock
I20260924 12:52:54.058976 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:40447
--webserver_interface=127.11.49.126
--webserver_port=0
--builtin_ntp_servers=127.11.49.84:46601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:40447
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42057/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/testchainca.cert with env {}
W20260924 12:52:54.486567 16617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:54.486979 16617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:54.487135 16617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:54.495445 16617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:54.495645 16617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:54.495754 16617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:54.495873 16617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:54.495967 16617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260924 12:52:54.496073 16617 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260924 12:52:54.496155 16617 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42057/jwks.json
I20260924 12:52:54.507984 16617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:46601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:40447
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:40447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42057/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:54.509521 16617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:54.511013 16617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:54.525856 16625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:54.526017 16623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:54.526273 16622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:54.527490 16617 server_base.cc:1034] running on GCE node
I20260924 12:52:54.528514 16617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:54.530115 16617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:54.531397 16617 hybrid_clock.cc:648] HybridClock initialized: now 1790254374531350 us; error 61 us; skew 500 ppm
I20260924 12:52:54.531858 16617 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:52:54.539328 16617 webserver.cc:460] Webserver started at http://127.11.49.126:34507/ using document root <none> and password file <none>
I20260924 12:52:54.540210 16617 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:54.540391 16617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:54.540751 16617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:54.544124 16617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "f7b443260c4043c69b9dc6286730beae"
format_stamp: "Formatted at 2026-09-24 12:52:54 on dist-test-slave-m9hg"
server_key: "d4bcf67b66866eeaed252566605365f0"
server_key_iv: "5c8253863b3b5af249569dcc49fe5c24"
server_key_version: "encryptionkey@0"
I20260924 12:52:54.545315 16617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "f7b443260c4043c69b9dc6286730beae"
format_stamp: "Formatted at 2026-09-24 12:52:54 on dist-test-slave-m9hg"
server_key: "d4bcf67b66866eeaed252566605365f0"
server_key_iv: "5c8253863b3b5af249569dcc49fe5c24"
server_key_version: "encryptionkey@0"
I20260924 12:52:54.551386 16617 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260924 12:52:54.555930 16631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:54.557891 16617 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:52:54.558148 16617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "f7b443260c4043c69b9dc6286730beae"
format_stamp: "Formatted at 2026-09-24 12:52:54 on dist-test-slave-m9hg"
server_key: "d4bcf67b66866eeaed252566605365f0"
server_key_iv: "5c8253863b3b5af249569dcc49fe5c24"
server_key_version: "encryptionkey@0"
I20260924 12:52:54.558408 16617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:54.574702 16617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:54.575619 16617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:54.575939 16617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:54.598157 16617 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:40447
I20260924 12:52:54.598299 16682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:40447 every 8 connection(s)
I20260924 12:52:54.599686 16617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:54.604774 16683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:54.609103 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 16617
I20260924 12:52:54.609392 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:54.610314 11461 external_mini_cluster.cc:1428] Setting key fe96dc514cac44c0c70f0f4c4a794fda
I20260924 12:52:54.621702 16683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae: Bootstrap starting.
I20260924 12:52:54.626350 16683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:54.626689 16686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:54.613366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55470 (local address 127.11.49.126:40447)
0924 12:52:54.614746 (+ 1380us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:54.614760 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:54.614811 (+ 51us) server_negotiation.cc:407] Connection header received
0924 12:52:54.617005 (+ 2194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:54.617033 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:54.617667 (+ 634us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:54.618176 (+ 509us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:54.618868 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:54.620221 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:54.621647 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:54.622465 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:54.622683 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:54.624000 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:54.624008 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:54.624024 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:54.624727 (+ 703us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:54.624827 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:54.624849 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:54.624979 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:54.625218 (+ 239us) server_negotiation.cc:299] Negotiation successful
0924 12:52:54.625575 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":799,"thread_start_us":479,"threads_started":1}
I20260924 12:52:54.627904 16683 log.cc:824] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:54.631448 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:52:54.631744 16683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae: No bootstrap required, opened a new log
I20260924 12:52:54.639571 16683 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b443260c4043c69b9dc6286730beae" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40447 } }
I20260924 12:52:54.640013 16683 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:54.640128 16683 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b443260c4043c69b9dc6286730beae, State: Initialized, Role: FOLLOWER
I20260924 12:52:54.640827 16683 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b443260c4043c69b9dc6286730beae" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40447 } }
I20260924 12:52:54.641095 16683 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:54.641224 16683 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:54.641386 16683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:54.644881 16683 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b443260c4043c69b9dc6286730beae" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40447 } }
I20260924 12:52:54.645481 16683 leader_election.cc:302] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7b443260c4043c69b9dc6286730beae; no voters:
I20260924 12:52:54.646222 16683 leader_election.cc:288] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:54.646498 16688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:54.647605 16688 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [term 1 LEADER]: Becoming Leader. State: Replica: f7b443260c4043c69b9dc6286730beae, State: Running, Role: LEADER
I20260924 12:52:54.648367 16688 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b443260c4043c69b9dc6286730beae" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40447 } }
I20260924 12:52:54.648653 16683 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:54.652835 16690 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7b443260c4043c69b9dc6286730beae. Latest consensus state: current_term: 1 leader_uuid: "f7b443260c4043c69b9dc6286730beae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b443260c4043c69b9dc6286730beae" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40447 } } }
I20260924 12:52:54.653128 16689 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7b443260c4043c69b9dc6286730beae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b443260c4043c69b9dc6286730beae" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40447 } } }
I20260924 12:52:54.653677 16690 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:54.653707 16689 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:54.656026 16697 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:54.662066 16697 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:54.672824 16697 catalog_manager.cc:1347] Generated new cluster ID: efc5bf60384e47af892aa8980f6e6aa7
I20260924 12:52:54.672966 16697 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:54.686875 16697 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:54.688895 16697 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:54.704152 16697 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7b443260c4043c69b9dc6286730beae: Generated new TSK 0
I20260924 12:52:54.706038 16697 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260924 12:52:54.755359 16713 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260924 12:52:54.755573 16713 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260924 12:52:54.756642 16686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:54.733024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55472 (local address 127.11.49.126:40447)
0924 12:52:54.733303 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:54.733312 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:54.733995 (+ 683us) server_negotiation.cc:407] Connection header received
0924 12:52:54.734481 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:54.734486 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:54.734569 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:54.734738 (+ 169us) server_negotiation.cc:226] Negotiated authn=JWT
0924 12:52:54.735530 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:54.736550 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:54.738950 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:54.739502 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:54.739617 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:54.740510 (+ 893us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0924 12:52:54.756049 (+ 15539us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42057/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0924 12:52:54.756425 (+ 376us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55472: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42057/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":90}
W20260924 12:52:54.756785 16686 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55472: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42057/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260924 12:52:54.760016 16712 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:52:54.732914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40447 (local address 127.0.0.1:55472)
0924 12:52:54.733828 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:54.733855 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:54.734134 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:54.734796 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:54.734802 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:54.734818 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0924 12:52:54.735333 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:54.735355 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:54.736727 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:54.736734 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:54.738731 (+ 1997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:54.738753 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:54.739719 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:54.739728 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:54.739953 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:54.740077 (+ 124us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0924 12:52:54.756547 (+ 16470us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42057/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0924 12:52:54.757104 (+ 557us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.49.126:40447: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42057/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":444,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.49.126:40447: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42057/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260924 12:52:54.762382 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 16617
I20260924 12:52:54.764111 16678 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:54.873934 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 16617
2026-09-24T12:52:54Z chronyd exiting
I20260924 12:52:54.926575 11461 test_util.cc:175] -----------------------------------------------
I20260924 12:52:54.926750 11461 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790254326970360-11461-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (912 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260924 12:52:54.930456 11461 mini_oidc.cc:152] Starting JWKS server
I20260924 12:52:54.932475 11461 webserver.cc:460] Webserver started at https://127.0.0.1:44509/ using document root <none> and password file <none>
I20260924 12:52:54.932698 11461 mini_oidc.cc:189] Starting OIDC Discovery server
I20260924 12:52:54.933326 11461 webserver.cc:460] Webserver started at http://127.0.0.1:40895/ using document root <none> and password file <none>
2026-09-24T12:52:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:54Z Disabled control of system clock
I20260924 12:52:54.964407 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:37741
--webserver_interface=127.11.49.126
--webserver_port=0
--builtin_ntp_servers=127.11.49.84:37893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:37741
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44509/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/testchainca.cert with env {}
W20260924 12:52:55.377441 16720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:55.377844 16720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:55.377949 16720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:55.386356 16720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:55.386528 16720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:55.386569 16720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:55.386638 16720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:55.386688 16720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260924 12:52:55.386754 16720 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260924 12:52:55.386801 16720 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44509/jwks.json
I20260924 12:52:55.398761 16720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:37893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:37741
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:37741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44509/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:55.400570 16720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:55.402298 16720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:55.417634 16726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:55.417623 16725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:55.418099 16728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:55.418979 16720 server_base.cc:1034] running on GCE node
I20260924 12:52:55.419978 16720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:55.421779 16720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:55.423061 16720 hybrid_clock.cc:648] HybridClock initialized: now 1790254375423006 us; error 65 us; skew 500 ppm
I20260924 12:52:55.423499 16720 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:52:55.432188 16720 webserver.cc:460] Webserver started at http://127.11.49.126:33767/ using document root <none> and password file <none>
I20260924 12:52:55.433174 16720 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:55.433337 16720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:55.433712 16720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:55.437098 16720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "8046a0ac245847929c6f57f9b8945b0b"
format_stamp: "Formatted at 2026-09-24 12:52:55 on dist-test-slave-m9hg"
server_key: "c488f374a7a4de2ca4ac4722cb2b55ec"
server_key_iv: "c9f660b71fd054401261c0c55dc99628"
server_key_version: "encryptionkey@0"
I20260924 12:52:55.438001 16720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "8046a0ac245847929c6f57f9b8945b0b"
format_stamp: "Formatted at 2026-09-24 12:52:55 on dist-test-slave-m9hg"
server_key: "c488f374a7a4de2ca4ac4722cb2b55ec"
server_key_iv: "c9f660b71fd054401261c0c55dc99628"
server_key_version: "encryptionkey@0"
I20260924 12:52:55.444468 16720 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260924 12:52:55.448969 16734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:55.450779 16720 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:52:55.451037 16720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "8046a0ac245847929c6f57f9b8945b0b"
format_stamp: "Formatted at 2026-09-24 12:52:55 on dist-test-slave-m9hg"
server_key: "c488f374a7a4de2ca4ac4722cb2b55ec"
server_key_iv: "c9f660b71fd054401261c0c55dc99628"
server_key_version: "encryptionkey@0"
I20260924 12:52:55.451303 16720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:55.478693 16720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:55.479663 16720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:55.480023 16720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:55.502290 16720 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:37741
I20260924 12:52:55.502393 16785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:37741 every 8 connection(s)
I20260924 12:52:55.503811 16720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:55.509035 16786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:55.510617 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 16720
I20260924 12:52:55.510843 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:55.511801 11461 external_mini_cluster.cc:1428] Setting key eea2d95e8d8ef4068e866d08e1017fc6
I20260924 12:52:55.527532 16786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b: Bootstrap starting.
I20260924 12:52:55.530200 16789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:55.514657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47352 (local address 127.11.49.126:37741)
0924 12:52:55.516211 (+ 1554us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:55.516229 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:55.516371 (+ 142us) server_negotiation.cc:407] Connection header received
0924 12:52:55.519026 (+ 2655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:55.519057 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:55.519687 (+ 630us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:55.520155 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:55.520847 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:55.522434 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:55.523902 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:55.524847 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:55.525067 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:55.526598 (+ 1531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:55.526607 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:55.526626 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:55.527305 (+ 679us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:55.527402 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:55.527428 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:55.527594 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:55.527960 (+ 366us) server_negotiation.cc:299] Negotiation successful
0924 12:52:55.528491 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":902,"thread_start_us":523,"threads_started":1}
I20260924 12:52:55.532619 16786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:55.534210 16786 log.cc:824] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:55.535149 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:52:55.538408 16786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b: No bootstrap required, opened a new log
I20260924 12:52:55.548022 16786 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8046a0ac245847929c6f57f9b8945b0b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37741 } }
I20260924 12:52:55.548736 16786 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:55.548862 16786 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8046a0ac245847929c6f57f9b8945b0b, State: Initialized, Role: FOLLOWER
I20260924 12:52:55.549757 16786 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8046a0ac245847929c6f57f9b8945b0b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37741 } }
I20260924 12:52:55.550268 16786 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:55.550506 16786 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:55.550753 16786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:55.553948 16786 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8046a0ac245847929c6f57f9b8945b0b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37741 } }
I20260924 12:52:55.554844 16786 leader_election.cc:302] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8046a0ac245847929c6f57f9b8945b0b; no voters:
I20260924 12:52:55.555826 16786 leader_election.cc:288] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:55.556093 16791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:55.558449 16786 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:55.563210 16791 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [term 1 LEADER]: Becoming Leader. State: Replica: 8046a0ac245847929c6f57f9b8945b0b, State: Running, Role: LEADER
I20260924 12:52:55.564060 16791 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8046a0ac245847929c6f57f9b8945b0b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37741 } }
I20260924 12:52:55.567986 16793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8046a0ac245847929c6f57f9b8945b0b. Latest consensus state: current_term: 1 leader_uuid: "8046a0ac245847929c6f57f9b8945b0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8046a0ac245847929c6f57f9b8945b0b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37741 } } }
I20260924 12:52:55.567977 16792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8046a0ac245847929c6f57f9b8945b0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8046a0ac245847929c6f57f9b8945b0b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37741 } } }
I20260924 12:52:55.568738 16805 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260924 12:52:55.569186 16793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:55.569743 16792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:55.571671 16806 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:55.577446 16806 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:55.599123 16806 catalog_manager.cc:1347] Generated new cluster ID: ba70cf2bc6fa4fc2b55bc7d25d3953e1
I20260924 12:52:55.599304 16806 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:55.650025 16806 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:55.652084 16806 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:55.668576 16806 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8046a0ac245847929c6f57f9b8945b0b: Generated new TSK 0
I20260924 12:52:55.669986 16806 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260924 12:52:55.716902 16816 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260924 12:52:55.717067 16816 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260924 12:52:55.718789 16789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:55.695816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47358 (local address 127.11.49.126:37741)
0924 12:52:55.696055 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:55.696060 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:55.696542 (+ 482us) server_negotiation.cc:407] Connection header received
0924 12:52:55.696971 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:55.696978 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:55.697118 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:55.697381 (+ 263us) server_negotiation.cc:226] Negotiated authn=JWT
0924 12:52:55.698114 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:55.699342 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:55.701035 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:55.701802 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:55.702012 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:55.702602 (+ 590us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0924 12:52:55.717830 (+ 15228us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44509/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0924 12:52:55.718404 (+ 574us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47358: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44509/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":69}
W20260924 12:52:55.718951 16789 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47358: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44509/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260924 12:52:55.719012 16815 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:52:55.695681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:37741 (local address 127.0.0.1:47358)
0924 12:52:55.696397 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:55.696421 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:55.696695 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:55.697423 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:55.697432 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:55.697450 (+ 18us) client_negotiation.cc:189] Negotiated authn=JWT
0924 12:52:55.697828 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:55.697841 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:55.699579 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:55.699585 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:55.700850 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:55.700863 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:55.702050 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:55.702054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:55.702200 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:55.702246 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0924 12:52:55.718201 (+ 15955us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44509/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0924 12:52:55.718603 (+ 402us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.49.126:37741: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44509/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":373,"threads_started":1}
I20260924 12:52:55.720468 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 16720
I20260924 12:52:55.721803 16781 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:55.821437 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 16720
2026-09-24T12:52:55Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (950 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260924 12:52:55.881269 11461 mini_oidc.cc:152] Starting JWKS server
I20260924 12:52:55.883733 11461 webserver.cc:460] Webserver started at https://127.0.0.1:41101/ using document root <none> and password file <none>
I20260924 12:52:55.884137 11461 mini_oidc.cc:189] Starting OIDC Discovery server
I20260924 12:52:55.884936 11461 webserver.cc:460] Webserver started at http://127.0.0.1:39915/ using document root <none> and password file <none>
2026-09-24T12:52:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:55Z Disabled control of system clock
I20260924 12:52:55.917438 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42527
--webserver_interface=127.11.49.126
--webserver_port=0
--builtin_ntp_servers=127.11.49.84:43523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:42527
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41101/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260924 12:52:56.346845 16823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:56.347407 16823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:56.347585 16823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:56.357445 16823 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:56.357679 16823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:56.357776 16823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:56.357894 16823 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:56.357982 16823 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260924 12:52:56.358111 16823 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260924 12:52:56.358196 16823 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41101/jwks.json
I20260924 12:52:56.370942 16823 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:42527
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41101/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:56.372989 16823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:56.375365 16823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:56.391196 16829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:56.391500 16831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:56.391489 16828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:56.393500 16823 server_base.cc:1034] running on GCE node
I20260924 12:52:56.394469 16823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:56.396350 16823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:56.397807 16823 hybrid_clock.cc:648] HybridClock initialized: now 1790254376397713 us; error 73 us; skew 500 ppm
I20260924 12:52:56.398334 16823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:52:56.401233 16823 webserver.cc:460] Webserver started at http://127.11.49.126:40215/ using document root <none> and password file <none>
I20260924 12:52:56.402034 16823 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:56.402169 16823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:56.402513 16823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:56.405676 16823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "832a8fa082134071860b6ca3a2b7db01"
format_stamp: "Formatted at 2026-09-24 12:52:56 on dist-test-slave-m9hg"
server_key: "bee4cd2e4161c05ae5ac954f6c5d8279"
server_key_iv: "8d9e0780847ad719244cd1cb34caaf5f"
server_key_version: "encryptionkey@0"
I20260924 12:52:56.406514 16823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "832a8fa082134071860b6ca3a2b7db01"
format_stamp: "Formatted at 2026-09-24 12:52:56 on dist-test-slave-m9hg"
server_key: "bee4cd2e4161c05ae5ac954f6c5d8279"
server_key_iv: "8d9e0780847ad719244cd1cb34caaf5f"
server_key_version: "encryptionkey@0"
I20260924 12:52:56.412499 16823 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260924 12:52:56.416803 16837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:56.418629 16823 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:52:56.418869 16823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "832a8fa082134071860b6ca3a2b7db01"
format_stamp: "Formatted at 2026-09-24 12:52:56 on dist-test-slave-m9hg"
server_key: "bee4cd2e4161c05ae5ac954f6c5d8279"
server_key_iv: "8d9e0780847ad719244cd1cb34caaf5f"
server_key_version: "encryptionkey@0"
I20260924 12:52:56.419113 16823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:56.452217 16823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:56.453209 16823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:56.453526 16823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:56.475504 16823 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:42527
I20260924 12:52:56.475575 16888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:42527 every 8 connection(s)
I20260924 12:52:56.477018 16823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:56.482331 16889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:56.485971 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 16823
I20260924 12:52:56.486265 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:56.486951 11461 external_mini_cluster.cc:1428] Setting key 94cee7046b4bea70cf86bf654677a853
I20260924 12:52:56.498785 16889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01: Bootstrap starting.
I20260924 12:52:56.502749 16892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:56.489773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58024 (local address 127.11.49.126:42527)
0924 12:52:56.491310 (+ 1537us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:56.491325 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:56.491379 (+ 54us) server_negotiation.cc:407] Connection header received
0924 12:52:56.493376 (+ 1997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:56.493404 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:56.493988 (+ 584us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:56.494429 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:56.495083 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:56.496572 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:56.497918 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:56.498684 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:56.498914 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:56.500129 (+ 1215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:56.500138 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:56.500154 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:56.500843 (+ 689us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:56.500943 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:56.500966 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:56.501105 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:56.501333 (+ 228us) server_negotiation.cc:299] Negotiation successful
0924 12:52:56.501684 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":972,"thread_start_us":522,"threads_started":1}
I20260924 12:52:56.503710 16889 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:56.505359 16889 log.cc:824] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:56.507908 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:52:56.509405 16889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01: No bootstrap required, opened a new log
I20260924 12:52:56.519577 16889 raft_consensus.cc:348] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "832a8fa082134071860b6ca3a2b7db01" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42527 } }
I20260924 12:52:56.520143 16889 raft_consensus.cc:374] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:56.520260 16889 raft_consensus.cc:729] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832a8fa082134071860b6ca3a2b7db01, State: Initialized, Role: FOLLOWER
I20260924 12:52:56.521144 16889 consensus_queue.cc:260] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "832a8fa082134071860b6ca3a2b7db01" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42527 } }
I20260924 12:52:56.521449 16889 raft_consensus.cc:388] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:56.521618 16889 raft_consensus.cc:482] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:56.521822 16889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:56.525177 16889 raft_consensus.cc:504] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "832a8fa082134071860b6ca3a2b7db01" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42527 } }
I20260924 12:52:56.526114 16889 leader_election.cc:302] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 832a8fa082134071860b6ca3a2b7db01; no voters:
I20260924 12:52:56.527062 16889 leader_election.cc:288] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:56.527132 16894 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:56.528228 16894 raft_consensus.cc:686] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [term 1 LEADER]: Becoming Leader. State: Replica: 832a8fa082134071860b6ca3a2b7db01, State: Running, Role: LEADER
I20260924 12:52:56.529012 16894 consensus_queue.cc:237] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "832a8fa082134071860b6ca3a2b7db01" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42527 } }
I20260924 12:52:56.530203 16889 sys_catalog.cc:564] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:56.532567 16896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "832a8fa082134071860b6ca3a2b7db01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "832a8fa082134071860b6ca3a2b7db01" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42527 } } }
I20260924 12:52:56.533099 16896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:56.533471 16895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 832a8fa082134071860b6ca3a2b7db01. Latest consensus state: current_term: 1 leader_uuid: "832a8fa082134071860b6ca3a2b7db01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "832a8fa082134071860b6ca3a2b7db01" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42527 } } }
I20260924 12:52:56.533991 16895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:56.536198 16902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:56.545284 16902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:56.546380 16911 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260924 12:52:56.558310 16902 catalog_manager.cc:1347] Generated new cluster ID: 4d5d091a911845429f9b021c367de40e
I20260924 12:52:56.558565 16902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:56.581336 16902 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:56.582881 16902 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:56.590925 16902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 832a8fa082134071860b6ca3a2b7db01: Generated new TSK 0
I20260924 12:52:56.591843 16902 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:52:56.623734 16892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:56.612659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58032 (local address 127.11.49.126:42527)
0924 12:52:56.612949 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:56.612956 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:56.613289 (+ 333us) server_negotiation.cc:407] Connection header received
0924 12:52:56.613550 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:56.613558 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:56.613674 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:56.613938 (+ 264us) server_negotiation.cc:226] Negotiated authn=JWT
0924 12:52:56.614461 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:56.615740 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:56.617678 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:56.618520 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:56.618706 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:56.619384 (+ 678us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0924 12:52:56.622784 (+ 3400us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41101/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0924 12:52:56.623348 (+ 564us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58032: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41101/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":100}
W20260924 12:52:56.623898 16892 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58032: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41101/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260924 12:52:56.625545 16918 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:52:56.612451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42527 (local address 127.0.0.1:58032)
0924 12:52:56.613166 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:56.613183 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:56.613332 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:56.613960 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:56.613964 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:56.613975 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0924 12:52:56.614274 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:56.614282 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:56.615988 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:56.615992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:56.617488 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:56.617505 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:56.618804 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:56.618810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:56.618974 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:56.619017 (+ 43us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0924 12:52:56.623078 (+ 4061us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41101/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0924 12:52:56.625047 (+ 1969us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.49.126:42527: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41101/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":1550,"thread_start_us":393,"threads_started":1}
I20260924 12:52:56.627926 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 16823
I20260924 12:52:56.629588 16884 generic_service.cc:196] Checking for leaks (request via RPC)
E20260924 12:52:56.637491 16919 webserver.cc:533] Webserver: sslize failed:
E20260924 12:52:56.637606 16919 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260924 12:52:56.738452 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 16823
2026-09-24T12:52:56Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (917 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-24T12:52:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:56Z Disabled control of system clock
I20260924 12:52:56.835279 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:41197
--webserver_interface=127.11.49.126
--webserver_port=0
--builtin_ntp_servers=127.11.49.84:46833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:41197
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/testchainca.cert with env {}
W20260924 12:52:57.272250 16924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:52:57.272732 16924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:52:57.272917 16924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:52:57.282517 16924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:52:57.282719 16924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:52:57.282840 16924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:52:57.282953 16924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:52:57.283032 16924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260924 12:52:57.283134 16924 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260924 12:52:57.283192 16924 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260924 12:52:57.295784 16924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:46833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:41197
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:41197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:52:57.297878 16924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:52:57.299973 16924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:52:57.315636 16929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:57.315779 16932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:52:57.315793 16930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:52:57.316916 16924 server_base.cc:1034] running on GCE node
I20260924 12:52:57.317937 16924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:52:57.319645 16924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:52:57.320895 16924 hybrid_clock.cc:648] HybridClock initialized: now 1790254377320840 us; error 68 us; skew 500 ppm
I20260924 12:52:57.321313 16924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:52:57.324760 16924 webserver.cc:460] Webserver started at http://127.11.49.126:38289/ using document root <none> and password file <none>
I20260924 12:52:57.325799 16924 fs_manager.cc:359] Metadata directory not provided
I20260924 12:52:57.325963 16924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:52:57.326529 16924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:52:57.330626 16924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "bd195492be7b4ac08c963a786a943c75"
format_stamp: "Formatted at 2026-09-24 12:52:57 on dist-test-slave-m9hg"
server_key: "8b0870d502d0c00a540e3e7009e6c451"
server_key_iv: "191327d8eb07ead2092179636e3b2ca5"
server_key_version: "encryptionkey@0"
I20260924 12:52:57.332365 16924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "bd195492be7b4ac08c963a786a943c75"
format_stamp: "Formatted at 2026-09-24 12:52:57 on dist-test-slave-m9hg"
server_key: "8b0870d502d0c00a540e3e7009e6c451"
server_key_iv: "191327d8eb07ead2092179636e3b2ca5"
server_key_version: "encryptionkey@0"
I20260924 12:52:57.340118 16924 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260924 12:52:57.345400 16938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:52:57.347597 16924 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260924 12:52:57.347918 16924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "bd195492be7b4ac08c963a786a943c75"
format_stamp: "Formatted at 2026-09-24 12:52:57 on dist-test-slave-m9hg"
server_key: "8b0870d502d0c00a540e3e7009e6c451"
server_key_iv: "191327d8eb07ead2092179636e3b2ca5"
server_key_version: "encryptionkey@0"
I20260924 12:52:57.348330 16924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:52:57.369463 16924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:52:57.370707 16924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:52:57.371189 16924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:52:57.395309 16924 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:41197
I20260924 12:52:57.395388 16989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:41197 every 8 connection(s)
I20260924 12:52:57.397210 16924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:52:57.401762 16990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:52:57.406080 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 16924
I20260924 12:52:57.406296 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:52:57.407125 11461 external_mini_cluster.cc:1428] Setting key a1225aff28faea207e24145a23ccee7b
I20260924 12:52:57.414189 16990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75: Bootstrap starting.
I20260924 12:52:57.417488 16990 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75: Neither blocks nor log segments found. Creating new log.
I20260924 12:52:57.418519 16990 log.cc:824] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75: Log is configured to *not* fsync() on all Append() calls
I20260924 12:52:57.421533 16990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75: No bootstrap required, opened a new log
I20260924 12:52:57.424737 16993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:57.409635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58856 (local address 127.11.49.126:41197)
0924 12:52:57.410966 (+ 1331us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:57.410981 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:57.411040 (+ 59us) server_negotiation.cc:407] Connection header received
0924 12:52:57.413284 (+ 2244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:57.413324 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:57.413990 (+ 666us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:57.414512 (+ 522us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:52:57.415219 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:57.416798 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:57.418333 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:57.419213 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:57.419501 (+ 288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:57.421254 (+ 1753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:52:57.421264 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:52:57.421285 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:52:57.422125 (+ 840us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:52:57.422240 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:52:57.422274 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:52:57.422470 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0924 12:52:57.422767 (+ 297us) server_negotiation.cc:299] Negotiation successful
0924 12:52:57.423239 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":772,"thread_start_us":493,"threads_started":1}
I20260924 12:52:57.430138 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:52:57.430768 16990 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd195492be7b4ac08c963a786a943c75" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41197 } }
I20260924 12:52:57.431173 16990 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:52:57.431284 16990 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd195492be7b4ac08c963a786a943c75, State: Initialized, Role: FOLLOWER
I20260924 12:52:57.431875 16990 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd195492be7b4ac08c963a786a943c75" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41197 } }
I20260924 12:52:57.432106 16990 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:52:57.432263 16990 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:52:57.432483 16990 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:52:57.435186 16990 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd195492be7b4ac08c963a786a943c75" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41197 } }
I20260924 12:52:57.435752 16990 leader_election.cc:302] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd195492be7b4ac08c963a786a943c75; no voters:
I20260924 12:52:57.436533 16990 leader_election.cc:288] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:52:57.436797 16995 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:52:57.437743 16995 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [term 1 LEADER]: Becoming Leader. State: Replica: bd195492be7b4ac08c963a786a943c75, State: Running, Role: LEADER
I20260924 12:52:57.438445 16995 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd195492be7b4ac08c963a786a943c75" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41197 } }
I20260924 12:52:57.438921 16990 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:52:57.443601 16997 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd195492be7b4ac08c963a786a943c75. Latest consensus state: current_term: 1 leader_uuid: "bd195492be7b4ac08c963a786a943c75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd195492be7b4ac08c963a786a943c75" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41197 } } }
I20260924 12:52:57.444108 16997 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:57.443742 16996 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd195492be7b4ac08c963a786a943c75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd195492be7b4ac08c963a786a943c75" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41197 } } }
I20260924 12:52:57.444329 16996 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75 [sys.catalog]: This master's current role is: LEADER
I20260924 12:52:57.449870 17005 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:52:57.455498 17005 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:52:57.466609 17005 catalog_manager.cc:1347] Generated new cluster ID: 6e5291a7631d4c0685e4e692f3ce88f2
I20260924 12:52:57.466782 17005 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:52:57.498050 17005 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:52:57.500139 17005 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:52:57.518046 17005 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd195492be7b4ac08c963a786a943c75: Generated new TSK 0
I20260924 12:52:57.519325 17005 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:52:57.577556 16993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:52:57.540331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58858 (local address 127.11.49.126:41197)
0924 12:52:57.540587 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0924 12:52:57.540598 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:52:57.541061 (+ 463us) server_negotiation.cc:407] Connection header received
0924 12:52:57.541372 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:52:57.541378 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:52:57.541485 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:52:57.541707 (+ 222us) server_negotiation.cc:226] Negotiated authn=JWT
0924 12:52:57.542306 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:57.543528 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:57.545668 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:52:57.546419 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:52:57.546573 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:57.547323 (+ 750us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0924 12:52:57.576741 (+ 29418us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0924 12:52:57.577190 (+ 449us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58858: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":99}
W20260924 12:52:57.577716 16993 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58858: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260924 12:52:57.578114 17019 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:52:57.540114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:41197 (local address 127.0.0.1:58858)
0924 12:52:57.540923 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0924 12:52:57.540946 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:52:57.541115 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:52:57.541770 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:52:57.541774 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:52:57.541786 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0924 12:52:57.542122 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:57.542132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:57.543745 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:57.543751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:57.545444 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:52:57.545466 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:52:57.546692 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:52:57.546707 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:52:57.546891 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:52:57.546975 (+ 84us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0924 12:52:57.577176 (+ 30201us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0924 12:52:57.577567 (+ 391us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.49.126:41197: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":460,"threads_started":1}
I20260924 12:52:57.579550 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 16924
I20260924 12:52:57.581274 16985 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:52:57.703903 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 16924
2026-09-24T12:52:57Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (945 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (452 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (421 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:52:58 dist-test-slave-m9hg krb5kdc[17034](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:52:58 dist-test-slave-m9hg krb5kdc[17034](info): set up 2 sockets
Sep 24 12:52:58 dist-test-slave-m9hg krb5kdc[17034](info): commencing operation
krb5kdc: starting...
W20260924 12:52:59.709836 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:52:59 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:52:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:52:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:52:59.969372 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:40859
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:40859
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:00.390259 17047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:00.390676 17047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:00.390795 17047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:00.399338 17047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:53:00.399523 17047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:00.399576 17047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:00.399643 17047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:53:00.399693 17047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:53:00.411245 17047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:40859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:40859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:00.413131 17047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:00.414777 17047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:00.430272 17052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:00.430538 17053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:00.430318 17055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:00.431429 17047 server_base.cc:1034] running on GCE node
I20260924 12:53:00.432610 17047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:00.434422 17047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:00.435721 17047 hybrid_clock.cc:648] HybridClock initialized: now 1790254380435639 us; error 91 us; skew 500 ppm
I20260924 12:53:00.436170 17047 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:00 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254380, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:00.445787 17047 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:53:00.447707 17047 webserver.cc:460] Webserver started at http://127.11.49.126:44775/ using document root <none> and password file <none>
I20260924 12:53:00.448565 17047 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:00.448683 17047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:00.448948 17047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:00.452107 17047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "10398927734c4258b2986d9ec09ac5d2"
format_stamp: "Formatted at 2026-09-24 12:53:00 on dist-test-slave-m9hg"
server_key: "939815af307b4d817148e274de7410ce"
server_key_iv: "277a04d0090daec50f87d465d8f6f6a6"
server_key_version: "encryptionkey@0"
I20260924 12:53:00.452973 17047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "10398927734c4258b2986d9ec09ac5d2"
format_stamp: "Formatted at 2026-09-24 12:53:00 on dist-test-slave-m9hg"
server_key: "939815af307b4d817148e274de7410ce"
server_key_iv: "277a04d0090daec50f87d465d8f6f6a6"
server_key_version: "encryptionkey@0"
I20260924 12:53:00.459157 17047 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260924 12:53:00.463455 17062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:00.465378 17047 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:53:00.465555 17047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "10398927734c4258b2986d9ec09ac5d2"
format_stamp: "Formatted at 2026-09-24 12:53:00 on dist-test-slave-m9hg"
server_key: "939815af307b4d817148e274de7410ce"
server_key_iv: "277a04d0090daec50f87d465d8f6f6a6"
server_key_version: "encryptionkey@0"
I20260924 12:53:00.465737 17047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:00.478866 17047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:00.483426 17047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:00.483708 17047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:00.505775 17047 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:40859
I20260924 12:53:00.505885 17113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:40859 every 8 connection(s)
I20260924 12:53:00.507346 17047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:53:00.512465 17114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:00.517705 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 17047
I20260924 12:53:00.517989 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:53:00.518882 11461 external_mini_cluster.cc:1428] Setting key b9b23f851a5167ab5b62c85ef45e3ae4
I20260924 12:53:00.527328 17114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2: Bootstrap starting.
I20260924 12:53:00.531580 17114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:00.533315 17114 log.cc:824] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2: Log is configured to *not* fsync() on all Append() calls
Sep 24 12:53:00 dist-test-slave-m9hg krb5kdc[17034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:00.537576 17114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2: No bootstrap required, opened a new log
I20260924 12:53:00.545027 17117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:00.521721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47902 (local address 127.11.49.126:40859)
0924 12:53:00.522746 (+ 1025us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:00.522762 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:00.522813 (+ 51us) server_negotiation.cc:407] Connection header received
0924 12:53:00.525599 (+ 2786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:00.525629 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:00.526117 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:00.526593 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:00.528199 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:00.529718 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:00.530984 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:00.531819 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:00.532016 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:00.537040 (+ 5024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:00.537048 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:00.537066 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:00.537110 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:00.540594 (+ 3484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:00.541324 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:00.541331 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:00.541338 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:00.541509 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:00.541908 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:00.541913 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:00.541916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:00.542510 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:00.542863 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:00.543322 (+ 459us) server_negotiation.cc:299] Negotiation successful
0924 12:53:00.543792 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":446,"threads_started":1}
I20260924 12:53:00.547866 17114 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10398927734c4258b2986d9ec09ac5d2" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40859 } }
I20260924 12:53:00.548632 17114 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:00.548763 17114 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10398927734c4258b2986d9ec09ac5d2, State: Initialized, Role: FOLLOWER
I20260924 12:53:00.549516 17114 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10398927734c4258b2986d9ec09ac5d2" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40859 } }
I20260924 12:53:00.549861 17114 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:53:00.550035 17114 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:53:00.550238 17114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:00.553431 17114 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10398927734c4258b2986d9ec09ac5d2" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40859 } }
I20260924 12:53:00.554153 17114 leader_election.cc:302] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10398927734c4258b2986d9ec09ac5d2; no voters:
I20260924 12:53:00.554909 17114 leader_election.cc:288] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:53:00.555137 17119 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:00.556370 17119 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [term 1 LEADER]: Becoming Leader. State: Replica: 10398927734c4258b2986d9ec09ac5d2, State: Running, Role: LEADER
I20260924 12:53:00.557189 17119 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10398927734c4258b2986d9ec09ac5d2" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40859 } }
I20260924 12:53:00.558408 17114 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:53:00.561206 17121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10398927734c4258b2986d9ec09ac5d2. Latest consensus state: current_term: 1 leader_uuid: "10398927734c4258b2986d9ec09ac5d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10398927734c4258b2986d9ec09ac5d2" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40859 } } }
I20260924 12:53:00.561971 17121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:00.561388 17120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10398927734c4258b2986d9ec09ac5d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10398927734c4258b2986d9ec09ac5d2" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40859 } } }
I20260924 12:53:00.563795 17120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2 [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:00.567889 17129 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:53:00.574898 17129 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:53:00.587601 17129 catalog_manager.cc:1347] Generated new cluster ID: a4fa049b912940929de21c88133a8fbe
I20260924 12:53:00.587798 17129 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:53:00.605340 17129 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:53:00.607337 17129 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:53:00.622295 17129 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10398927734c4258b2986d9ec09ac5d2: Generated new TSK 0
I20260924 12:53:00.623497 17129 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:53:00.689644 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40859
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:01.112200 17140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:01.112665 17140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:01.112778 17140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:01.121236 17140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:01.121407 17140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:01.121542 17140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:53:01.133898 17140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40859
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:01.135854 17140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:01.137722 17140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:01.155203 17146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:01.155210 17148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:01.156376 17145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:01.156474 17140 server_base.cc:1034] running on GCE node
I20260924 12:53:01.157352 17140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:01.158849 17140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:01.160145 17140 hybrid_clock.cc:648] HybridClock initialized: now 1790254381160087 us; error 52 us; skew 500 ppm
I20260924 12:53:01.160642 17140 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:01 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254381, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:01.165288 17140 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:53:01.167824 17140 webserver.cc:460] Webserver started at http://127.11.49.65:40327/ using document root <none> and password file <none>
I20260924 12:53:01.169380 17140 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:01.169555 17140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:01.169931 17140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:01.174599 17140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "deed2980bb6c456688e26cb4236e88a5"
format_stamp: "Formatted at 2026-09-24 12:53:01 on dist-test-slave-m9hg"
server_key: "9d457260460f0430269446a060813e39"
server_key_iv: "a62fbb8d25cedf32cbef415beae4b300"
server_key_version: "encryptionkey@0"
I20260924 12:53:01.175762 17140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "deed2980bb6c456688e26cb4236e88a5"
format_stamp: "Formatted at 2026-09-24 12:53:01 on dist-test-slave-m9hg"
server_key: "9d457260460f0430269446a060813e39"
server_key_iv: "a62fbb8d25cedf32cbef415beae4b300"
server_key_version: "encryptionkey@0"
I20260924 12:53:01.183492 17140 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260924 12:53:01.188652 17155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:01.190727 17140 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:53:01.191013 17140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "deed2980bb6c456688e26cb4236e88a5"
format_stamp: "Formatted at 2026-09-24 12:53:01 on dist-test-slave-m9hg"
server_key: "9d457260460f0430269446a060813e39"
server_key_iv: "a62fbb8d25cedf32cbef415beae4b300"
server_key_version: "encryptionkey@0"
I20260924 12:53:01.191320 17140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:01.241235 17140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:01.247200 17140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:01.247603 17140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:01.249099 17140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:01.250895 17140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:01.250981 17140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:01.251135 17140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:01.251206 17140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:01.292654 17140 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:44793
I20260924 12:53:01.292719 17267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:44793 every 8 connection(s)
I20260924 12:53:01.294374 17140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:53:01.300117 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 17140
I20260924 12:53:01.300447 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:53:01.301265 11461 external_mini_cluster.cc:1428] Setting key b76f584a6c252e1a0cbe6c8a4aab1413
Sep 24 12:53:01 dist-test-slave-m9hg krb5kdc[17034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254381, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:01.319156 17270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:01.298090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:33189 (local address 127.11.49.126:40859)
0924 12:53:01.298657 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:01.298662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:01.300163 (+ 1501us) server_negotiation.cc:407] Connection header received
0924 12:53:01.302629 (+ 2466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:01.302637 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:01.302725 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:01.302925 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:01.304973 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:01.305704 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:01.307370 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:01.307784 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:01.307925 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:01.311777 (+ 3852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:01.311782 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:01.311786 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:01.311820 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:01.314987 (+ 3167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:01.316136 (+ 1149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:01.316142 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:01.316144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:01.316396 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:01.317026 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:01.317031 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:01.317034 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:01.317429 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:01.317598 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:01.318602 (+ 1004us) server_negotiation.cc:299] Negotiation successful
0924 12:53:01.318849 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":429,"thread_start_us":291,"threads_started":1}
I20260924 12:53:01.320714 17271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:01.298921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40859 (local address 127.11.49.65:33189)
0924 12:53:01.299950 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:01.300006 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:01.302152 (+ 2146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:01.303208 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:01.303217 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:01.304026 (+ 809us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:01.304773 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:01.304794 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:01.305893 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:01.305897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:01.307210 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:01.307224 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:01.308048 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:01.308055 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:01.308398 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:01.309154 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:01.309179 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:01.311508 (+ 2329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:01.315201 (+ 3693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:01.315213 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:01.315235 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:01.315933 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:01.316528 (+ 595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:01.316537 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:01.316544 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:01.316839 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:01.317585 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:01.317597 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:01.318116 (+ 519us) client_negotiation.cc:769] Sending connection context
0924 12:53:01.318446 (+ 330us) client_negotiation.cc:240] Negotiation successful
0924 12:53:01.319059 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":446,"threads_started":1}
I20260924 12:53:01.322928 17268 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40859
I20260924 12:53:01.323478 17268 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:01.324632 17268 heartbeater.cc:511] Master 127.11.49.126:40859 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:53:01.327733 17079 ts_manager.cc:194] Registered new tserver with Master: deed2980bb6c456688e26cb4236e88a5 (127.11.49.65:44793)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
I20260924 12:53:01.329697 17079 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:33189
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:53:01.360431 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40859
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:01.723465 17274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:01.723869 17274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:01.724054 17274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:01.731556 17274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:01.731742 17274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:01.731922 17274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:53:01.742015 17274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40859
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:01.743418 17274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:01.744761 17274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:01.759539 17279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:01.759611 17280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:01.759611 17282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:01.760854 17274 server_base.cc:1034] running on GCE node
I20260924 12:53:01.761646 17274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:01.762831 17274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:01.764118 17274 hybrid_clock.cc:648] HybridClock initialized: now 1790254381764028 us; error 58 us; skew 500 ppm
I20260924 12:53:01.764734 17274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:01 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254381, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:01.769562 17274 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:53:01.771445 17274 webserver.cc:460] Webserver started at http://127.11.49.66:41617/ using document root <none> and password file <none>
I20260924 12:53:01.772217 17274 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:01.772431 17274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:01.772790 17274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:01.775899 17274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "1c4ebda94fed4f8faabbf2d1adf47ea9"
format_stamp: "Formatted at 2026-09-24 12:53:01 on dist-test-slave-m9hg"
server_key: "2a0f33e1d0181acdbbfe71b5f552704c"
server_key_iv: "a885a1f6e0fdb0ebf3da7a9581993447"
server_key_version: "encryptionkey@0"
I20260924 12:53:01.776829 17274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "1c4ebda94fed4f8faabbf2d1adf47ea9"
format_stamp: "Formatted at 2026-09-24 12:53:01 on dist-test-slave-m9hg"
server_key: "2a0f33e1d0181acdbbfe71b5f552704c"
server_key_iv: "a885a1f6e0fdb0ebf3da7a9581993447"
server_key_version: "encryptionkey@0"
I20260924 12:53:01.782895 17274 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.002s
I20260924 12:53:01.787783 17289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:01.789914 17274 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:53:01.790154 17274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "1c4ebda94fed4f8faabbf2d1adf47ea9"
format_stamp: "Formatted at 2026-09-24 12:53:01 on dist-test-slave-m9hg"
server_key: "2a0f33e1d0181acdbbfe71b5f552704c"
server_key_iv: "a885a1f6e0fdb0ebf3da7a9581993447"
server_key_version: "encryptionkey@0"
I20260924 12:53:01.790393 17274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:01.811229 17274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:01.816066 17274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:01.816414 17274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:01.817605 17274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:01.819199 17274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:01.819280 17274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:01.819414 17274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:01.819482 17274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:01.860178 17274 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:46047
I20260924 12:53:01.860357 17401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:46047 every 8 connection(s)
I20260924 12:53:01.861582 17274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:53:01.869377 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 17274
I20260924 12:53:01.869586 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:53:01.870069 11461 external_mini_cluster.cc:1428] Setting key 002519cbfa3230e791d45b9fdf785a66
Sep 24 12:53:01 dist-test-slave-m9hg krb5kdc[17034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254381, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:01.890424 17404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:01.865037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:36435 (local address 127.11.49.126:40859)
0924 12:53:01.865586 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:01.865592 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:01.866732 (+ 1140us) server_negotiation.cc:407] Connection header received
0924 12:53:01.869546 (+ 2814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:01.869553 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:01.869735 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:01.869894 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:01.872473 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:01.873571 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:01.875648 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:01.876423 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:01.876608 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:01.881619 (+ 5011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:01.881629 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:01.881638 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:01.881700 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:01.885713 (+ 4013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:01.886938 (+ 1225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:01.886949 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:01.886955 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:01.887184 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:01.887837 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:01.887845 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:01.887851 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:01.888377 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:01.888572 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:01.889509 (+ 937us) server_negotiation.cc:299] Negotiation successful
0924 12:53:01.889879 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":269,"threads_started":1}
I20260924 12:53:01.891098 17405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:01.865573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40859 (local address 127.11.49.66:36435)
0924 12:53:01.866502 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:01.866560 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:01.869045 (+ 2485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:01.870298 (+ 1253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:01.870320 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:01.871290 (+ 970us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:01.872186 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:01.872223 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:01.873782 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:01.873787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:01.875436 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:01.875454 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:01.876730 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:01.876736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:01.877041 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:01.877964 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:01.878002 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:01.881242 (+ 3240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:01.886009 (+ 4767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:01.886018 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:01.886035 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:01.886631 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:01.887395 (+ 764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:01.887400 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:01.887403 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:01.887650 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:01.888538 (+ 888us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:01.888545 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:01.888998 (+ 453us) client_negotiation.cc:769] Sending connection context
0924 12:53:01.889315 (+ 317us) client_negotiation.cc:240] Negotiation successful
0924 12:53:01.889790 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":370,"threads_started":1}
I20260924 12:53:01.892988 17402 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40859
I20260924 12:53:01.893518 17402 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:01.894829 17402 heartbeater.cc:511] Master 127.11.49.126:40859 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
I20260924 12:53:01.897101 17079 ts_manager.cc:194] Registered new tserver with Master: 1c4ebda94fed4f8faabbf2d1adf47ea9 (127.11.49.66:46047)
I20260924 12:53:01.898032 17079 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:36435
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:53:01.929854 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40859
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:53:02.333364 17268 heartbeater.cc:503] Master 127.11.49.126:40859 was elected leader, sending a full tablet report...
W20260924 12:53:02.343115 17408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:02.343597 17408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:02.343765 17408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:02.352141 17408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:02.352609 17408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:02.352903 17408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:53:02.365926 17408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40859
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:02.367897 17408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:02.369791 17408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:02.386734 17413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:02.386776 17414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:02.387076 17416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:02.388612 17408 server_base.cc:1034] running on GCE node
I20260924 12:53:02.389407 17408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:02.390587 17408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:02.391853 17408 hybrid_clock.cc:648] HybridClock initialized: now 1790254382391787 us; error 97 us; skew 500 ppm
I20260924 12:53:02.392238 17408 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:02.396406 17408 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:53:02.398236 17408 webserver.cc:460] Webserver started at http://127.11.49.67:38585/ using document root <none> and password file <none>
I20260924 12:53:02.399032 17408 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:02.399184 17408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:02.399508 17408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:02.402570 17408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "89137a3c74ad4833bc242e888af8f36f"
format_stamp: "Formatted at 2026-09-24 12:53:02 on dist-test-slave-m9hg"
server_key: "86b7d36c5c1994894651af12a73501bd"
server_key_iv: "a75d6e8e2e01b9851c713a1d33a77f45"
server_key_version: "encryptionkey@0"
I20260924 12:53:02.403390 17408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "89137a3c74ad4833bc242e888af8f36f"
format_stamp: "Formatted at 2026-09-24 12:53:02 on dist-test-slave-m9hg"
server_key: "86b7d36c5c1994894651af12a73501bd"
server_key_iv: "a75d6e8e2e01b9851c713a1d33a77f45"
server_key_version: "encryptionkey@0"
I20260924 12:53:02.409324 17408 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260924 12:53:02.413642 17423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:02.415390 17408 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:53:02.415637 17408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "89137a3c74ad4833bc242e888af8f36f"
format_stamp: "Formatted at 2026-09-24 12:53:02 on dist-test-slave-m9hg"
server_key: "86b7d36c5c1994894651af12a73501bd"
server_key_iv: "a75d6e8e2e01b9851c713a1d33a77f45"
server_key_version: "encryptionkey@0"
I20260924 12:53:02.415910 17408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:02.435075 17408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:02.439865 17408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:02.440171 17408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:02.441283 17408 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:02.442740 17408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:02.442842 17408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:02.443002 17408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:02.443074 17408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:02.482779 17408 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:46219
I20260924 12:53:02.482904 17535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:46219 every 8 connection(s)
I20260924 12:53:02.484170 17408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:53:02.487294 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 17408
I20260924 12:53:02.487481 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:53:02.488036 11461 external_mini_cluster.cc:1428] Setting key ac9df9467633bea36c7b85388d1f2b97
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:02.508875 17538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:02.487684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:35287 (local address 127.11.49.126:40859)
0924 12:53:02.488425 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:02.488430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:02.489491 (+ 1061us) server_negotiation.cc:407] Connection header received
0924 12:53:02.491726 (+ 2235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:02.491733 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:02.491881 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:02.491990 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:02.493560 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.494587 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.496494 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.497000 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.497129 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:02.501136 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:02.501142 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:02.501147 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:02.501202 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:02.504960 (+ 3758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.506193 (+ 1233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.506197 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.506199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.506348 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.506881 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.506885 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.506887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.507179 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:02.507334 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:02.508378 (+ 1044us) server_negotiation.cc:299] Negotiation successful
0924 12:53:02.508573 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":342,"threads_started":1}
I20260924 12:53:02.510594 17539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:02.488316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40859 (local address 127.11.49.67:35287)
0924 12:53:02.489291 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:02.489340 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:02.491440 (+ 2100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:02.492226 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:02.492235 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:02.492814 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:02.493373 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:02.493389 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.494828 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.494832 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:02.496259 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:02.496342 (+ 83us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.497230 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.497235 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:02.497430 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:02.498228 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:02.498253 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:02.500739 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:02.505199 (+ 4460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:02.505211 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:02.505236 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:02.506031 (+ 795us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:02.506476 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:02.506482 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:02.506486 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:02.506762 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:02.507304 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:02.507313 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:02.507867 (+ 554us) client_negotiation.cc:769] Sending connection context
0924 12:53:02.508218 (+ 351us) client_negotiation.cc:240] Negotiation successful
0924 12:53:02.508918 (+ 700us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":429,"threads_started":1}
I20260924 12:53:02.512398 17536 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40859
I20260924 12:53:02.512820 17536 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:02.513942 17536 heartbeater.cc:511] Master 127.11.49.126:40859 requested a full tablet report, sending...
I20260924 12:53:02.515872 17079 ts_manager.cc:194] Registered new tserver with Master: 89137a3c74ad4833bc242e888af8f36f (127.11.49.67:46219)
I20260924 12:53:02.516988 17079 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:35287
I20260924 12:53:02.518182 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/test-admin.keytab.
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:02.547371 11461 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260924 12:53:02.554160 17544 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:02.550584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56196 (local address 127.11.49.65:44793)
0924 12:53:02.551584 (+ 1000us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:02.551594 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:02.551630 (+ 36us) server_negotiation.cc:407] Connection header received
0924 12:53:02.551718 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:02.551727 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:02.552021 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:02.552209 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:02.553551 (+ 1342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56196: BlockingRecv error: recv got EOF from 127.0.0.1:56196 (error 108)
Metrics: {"server-negotiator.queue_time_us":792,"thread_start_us":589,"threads_started":1}
W20260924 12:53:02.554262 11461 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/krb5cc' of type FILE
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:02.556401 11461 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:02.558116 11461 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:53:02.578027 17544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:02.560470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56204 (local address 127.11.49.65:44793)
0924 12:53:02.560679 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:02.560684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:02.560859 (+ 175us) server_negotiation.cc:407] Connection header received
0924 12:53:02.561030 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:02.561035 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:02.561113 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:02.561231 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:02.562369 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.563512 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.565006 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.565761 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.565941 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:02.570567 (+ 4626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:02.570592 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:02.570644 (+ 52us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:02.570702 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:02.574429 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.575338 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.575347 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.575350 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.575567 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.576077 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.576081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.576083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.576656 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:02.576946 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:02.577266 (+ 320us) server_negotiation.cc:299] Negotiation successful
0924 12:53:02.577662 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260924 12:53:02.585424 17544 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:02.583347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56214 (local address 127.11.49.65:44793)
0924 12:53:02.583627 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:02.583637 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:02.583796 (+ 159us) server_negotiation.cc:407] Connection header received
0924 12:53:02.583907 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:02.583914 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:02.583997 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:02.584091 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:02.585040 (+ 949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56214: BlockingRecv error: recv got EOF from 127.0.0.1:56214 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
W20260924 12:53:02.585534 11461 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/krb5cc' of type FILE
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:02.587371 11461 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:02.589046 11461 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:53:02.606894 17544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:02.590718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56216 (local address 127.11.49.65:44793)
0924 12:53:02.591054 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:02.591065 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:02.591367 (+ 302us) server_negotiation.cc:407] Connection header received
0924 12:53:02.591526 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:02.591532 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:02.591616 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:02.591723 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:02.592764 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.593604 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.595213 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.595766 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.595989 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:02.600529 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:02.600537 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:02.600541 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:02.600612 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:02.603656 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.604646 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.604652 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.604655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.604897 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.605356 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.605361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.605363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.605717 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:02.605979 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:02.606233 (+ 254us) server_negotiation.cc:299] Negotiation successful
0924 12:53:02.606562 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
W20260924 12:53:02.612746 17544 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:02.610343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56218 (local address 127.11.49.65:44793)
0924 12:53:02.610525 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:02.610531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:02.611039 (+ 508us) server_negotiation.cc:407] Connection header received
0924 12:53:02.611224 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:02.611228 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:02.611334 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:02.611437 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:02.612424 (+ 987us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56218: BlockingRecv error: recv got EOF from 127.0.0.1:56218 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260924 12:53:02.613029 11461 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790254326970360-11461-0/krb5kdc/krb5cc' of type FILE
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:02.614697 11461 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:02.616122 11461 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:53:02.633335 17544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:02.617617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56224 (local address 127.11.49.65:44793)
0924 12:53:02.617784 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:02.617790 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:02.618303 (+ 513us) server_negotiation.cc:407] Connection header received
0924 12:53:02.618446 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:02.618450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:02.618511 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:02.618605 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:02.619650 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.620574 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.622243 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.622668 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.622774 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:02.627185 (+ 4411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:02.627191 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:02.627194 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:02.627233 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:02.630224 (+ 2991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.631173 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.631176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.631179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.631362 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.631809 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.631812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.631814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.632095 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:02.632433 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:02.632850 (+ 417us) server_negotiation.cc:299] Negotiation successful
0924 12:53:02.633047 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260924 12:53:02.635349 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 17140
I20260924 12:53:02.649222 17544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:02.636184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56232 (local address 127.11.49.65:44793)
0924 12:53:02.636461 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:02.636466 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:02.636714 (+ 248us) server_negotiation.cc:407] Connection header received
0924 12:53:02.636872 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:02.636876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:02.636950 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:02.637053 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:02.638107 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.638859 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.640247 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.640786 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.640908 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:02.642961 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:02.642966 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:02.642969 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:02.643008 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:02.646154 (+ 3146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.646994 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.647002 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.647005 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.647181 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.647566 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.647570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.647572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.647909 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:02.648164 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:02.648676 (+ 512us) server_negotiation.cc:299] Negotiation successful
0924 12:53:02.648923 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260924 12:53:02.650039 17263 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:02.737324 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 17140
I20260924 12:53:02.754370 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 17274
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:53:02.774924 17557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:02.755621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52242 (local address 127.11.49.66:46047)
0924 12:53:02.756601 (+ 980us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:02.756610 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:02.756647 (+ 37us) server_negotiation.cc:407] Connection header received
0924 12:53:02.756733 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:02.756740 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:02.757022 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:02.757202 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:02.758252 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.759674 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.761496 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.762235 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.762394 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:02.767257 (+ 4863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:02.767281 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:02.767305 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:02.767410 (+ 105us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:02.771219 (+ 3809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.772449 (+ 1230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.772457 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.772460 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.772659 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.773128 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.773133 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.773135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.773615 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:02.773886 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:02.774361 (+ 475us) server_negotiation.cc:299] Negotiation successful
0924 12:53:02.774597 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":783,"thread_start_us":621,"threads_started":1}
I20260924 12:53:02.776597 17397 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:02.872447 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 17274
I20260924 12:53:02.888734 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 17408
Sep 24 12:53:02 dist-test-slave-m9hg krb5kdc[17034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:53:02.908557 17559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:02.889949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49832 (local address 127.11.49.67:46219)
0924 12:53:02.890757 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:02.890767 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:02.890808 (+ 41us) server_negotiation.cc:407] Connection header received
0924 12:53:02.890928 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:02.890936 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:02.891243 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:02.891438 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:02.892565 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.893838 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.895121 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:02.895912 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:02.896057 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:02.900931 (+ 4874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:02.900951 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:02.900971 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:02.901032 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:02.904804 (+ 3772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.905840 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.905850 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.905853 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.906031 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:02.906517 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:02.906525 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:02.906528 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:02.907000 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:02.907389 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:02.907744 (+ 355us) server_negotiation.cc:299] Negotiation successful
0924 12:53:02.908091 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":381,"threads_started":1}
I20260924 12:53:02.910091 17531 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:03.007941 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 17408
I20260924 12:53:03.024523 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 17047
I20260924 12:53:03.025818 17109 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:03.133376 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 17047
2026-09-24T12:53:03Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4559 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:53:03 dist-test-slave-m9hg krb5kdc[17564](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:53:03 dist-test-slave-m9hg krb5kdc[17564](info): set up 2 sockets
Sep 24 12:53:03 dist-test-slave-m9hg krb5kdc[17564](info): commencing operation
krb5kdc: starting...
W20260924 12:53:04.261777 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:53:04 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:53:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:53:04Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.126.keytab.
Entry for principal oryx/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.126.keytab.
I20260924 12:53:04.529412 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:40841
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.126.keytab
--principal=oryx/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:40841
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:04.954507 17577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:04.954932 17577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:04.955132 17577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:04.963501 17577 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:53:04.963719 17577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:04.963810 17577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:04.963922 17577 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:53:04.963984 17577 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:53:04.975694 17577 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:40841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.126.keytab
--principal=oryx/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:40841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:04.977488 17577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:04.979075 17577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:04.994058 17585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:04.994098 17582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:04.993945 17583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:04.995319 17577 server_base.cc:1034] running on GCE node
I20260924 12:53:04.996397 17577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:04.998135 17577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:04.999447 17577 hybrid_clock.cc:648] HybridClock initialized: now 1790254384999360 us; error 84 us; skew 500 ppm
I20260924 12:53:04.999938 17577 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:04 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254384, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:05.003798 17577 init.cc:377] Logged in from keytab as oryx/127.11.49.126@KRBTEST.COM (short username oryx)
I20260924 12:53:05.005823 17577 webserver.cc:460] Webserver started at http://127.11.49.126:38321/ using document root <none> and password file <none>
I20260924 12:53:05.006676 17577 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:05.006839 17577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:05.007166 17577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:05.010427 17577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "7948b76170d6434aad3f4d489ee0b03d"
format_stamp: "Formatted at 2026-09-24 12:53:05 on dist-test-slave-m9hg"
server_key: "15dc15c3b1ba251a920dc391938ca66f"
server_key_iv: "e39058f1095611a922b12505f8c8145c"
server_key_version: "encryptionkey@0"
I20260924 12:53:05.011312 17577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "7948b76170d6434aad3f4d489ee0b03d"
format_stamp: "Formatted at 2026-09-24 12:53:05 on dist-test-slave-m9hg"
server_key: "15dc15c3b1ba251a920dc391938ca66f"
server_key_iv: "e39058f1095611a922b12505f8c8145c"
server_key_version: "encryptionkey@0"
I20260924 12:53:05.017679 17577 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260924 12:53:05.022002 17592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:05.023906 17577 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:53:05.024144 17577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "7948b76170d6434aad3f4d489ee0b03d"
format_stamp: "Formatted at 2026-09-24 12:53:05 on dist-test-slave-m9hg"
server_key: "15dc15c3b1ba251a920dc391938ca66f"
server_key_iv: "e39058f1095611a922b12505f8c8145c"
server_key_version: "encryptionkey@0"
I20260924 12:53:05.024425 17577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:05.050621 17577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:05.055501 17577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:05.055917 17577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:05.079140 17577 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:40841
I20260924 12:53:05.079243 17643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:40841 every 8 connection(s)
I20260924 12:53:05.080700 17577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:53:05.085839 17644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:05.087023 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 17577
I20260924 12:53:05.087257 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:53:05.087996 11461 external_mini_cluster.cc:1428] Setting key 3ff63fe99b900f30b827e9bbb9a68c45
I20260924 12:53:05.104246 17644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d: Bootstrap starting.
Sep 24 12:53:05 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:05.109144 17644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:05.111088 17644 log.cc:824] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:05.116183 17644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d: No bootstrap required, opened a new log
I20260924 12:53:05.118642 17647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:05.090582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33012 (local address 127.11.49.126:40841)
0924 12:53:05.091565 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:05.091582 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:05.091628 (+ 46us) server_negotiation.cc:407] Connection header received
0924 12:53:05.093577 (+ 1949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:05.093602 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:05.094064 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:05.094457 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:05.097083 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:05.098582 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:05.100725 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:05.101583 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:05.101749 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:05.107396 (+ 5647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:05.107411 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:05.107435 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:05.107502 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:05.112571 (+ 5069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:05.113629 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:05.113643 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:05.113662 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:05.113974 (+ 312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:05.114469 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:05.114474 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:05.114478 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:05.115367 (+ 889us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:05.115767 (+ 400us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:05.116240 (+ 473us) server_negotiation.cc:299] Negotiation successful
0924 12:53:05.116924 (+ 684us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":468,"threads_started":1}
I20260924 12:53:05.126792 17644 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } }
I20260924 12:53:05.127329 17644 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:05.127447 17644 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7948b76170d6434aad3f4d489ee0b03d, State: Initialized, Role: FOLLOWER
I20260924 12:53:05.128345 17644 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } }
I20260924 12:53:05.128746 17644 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:53:05.128906 17644 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:53:05.129120 17644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:05.131815 17644 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } }
I20260924 12:53:05.132686 17644 leader_election.cc:302] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7948b76170d6434aad3f4d489ee0b03d; no voters:
I20260924 12:53:05.133515 17644 leader_election.cc:288] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:53:05.133687 17649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:05.134639 17649 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 1 LEADER]: Becoming Leader. State: Replica: 7948b76170d6434aad3f4d489ee0b03d, State: Running, Role: LEADER
I20260924 12:53:05.135311 17649 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } }
I20260924 12:53:05.136418 17644 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:53:05.138568 17650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } }
I20260924 12:53:05.138687 17651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7948b76170d6434aad3f4d489ee0b03d. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } }
I20260924 12:53:05.139010 17650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:05.139010 17651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:05.146775 17654 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:53:05.158211 17654 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:53:05.171270 17654 catalog_manager.cc:1347] Generated new cluster ID: fbf514c5d25b49c68fa830f42d936032
I20260924 12:53:05.171506 17654 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:53:05.201082 17654 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:53:05.203308 17654 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:53:05.221776 17654 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d: Generated new TSK 0
I20260924 12:53:05.223014 17654 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab.
Entry for principal oryx/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab.
I20260924 12:53:05.297533 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40841
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab
--principal=oryx/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:05.671803 17670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:05.672147 17670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:05.672340 17670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:05.679948 17670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:05.680088 17670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:05.680262 17670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:53:05.690589 17670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab
--principal=oryx/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40841
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:05.691882 17670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:05.693230 17670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:05.711827 17675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:05.711874 17676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:05.712129 17678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:05.714044 17670 server_base.cc:1034] running on GCE node
I20260924 12:53:05.715384 17670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:05.717633 17670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:05.718991 17670 hybrid_clock.cc:648] HybridClock initialized: now 1790254385718886 us; error 80 us; skew 500 ppm
I20260924 12:53:05.719604 17670 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:05 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254385, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:05.725641 17670 init.cc:377] Logged in from keytab as oryx/127.11.49.65@KRBTEST.COM (short username oryx)
I20260924 12:53:05.727844 17670 webserver.cc:460] Webserver started at http://127.11.49.65:40365/ using document root <none> and password file <none>
I20260924 12:53:05.729240 17670 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:05.729436 17670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:05.729905 17670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:05.735423 17670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "12dfc0d55448464ab20e07e9de4d07ac"
format_stamp: "Formatted at 2026-09-24 12:53:05 on dist-test-slave-m9hg"
server_key: "4240bb61f6f57e97bb794bda547c54f2"
server_key_iv: "64de62573cc21190cb0a57b44c3e4605"
server_key_version: "encryptionkey@0"
I20260924 12:53:05.737130 17670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "12dfc0d55448464ab20e07e9de4d07ac"
format_stamp: "Formatted at 2026-09-24 12:53:05 on dist-test-slave-m9hg"
server_key: "4240bb61f6f57e97bb794bda547c54f2"
server_key_iv: "64de62573cc21190cb0a57b44c3e4605"
server_key_version: "encryptionkey@0"
I20260924 12:53:05.747715 17670 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.005s sys 0.004s
I20260924 12:53:05.754791 17685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:05.757352 17670 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.003s
I20260924 12:53:05.757633 17670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "12dfc0d55448464ab20e07e9de4d07ac"
format_stamp: "Formatted at 2026-09-24 12:53:05 on dist-test-slave-m9hg"
server_key: "4240bb61f6f57e97bb794bda547c54f2"
server_key_iv: "64de62573cc21190cb0a57b44c3e4605"
server_key_version: "encryptionkey@0"
I20260924 12:53:05.757997 17670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:05.773074 17670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:05.778926 17670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:05.779294 17670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:05.780594 17670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:05.782523 17670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:05.782642 17670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:05.782804 17670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:05.782894 17670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:05.825033 17670 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:38009
I20260924 12:53:05.825084 17797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:38009 every 8 connection(s)
I20260924 12:53:05.826726 17670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:53:05.830231 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 17670
I20260924 12:53:05.830466 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:53:05.831146 11461 external_mini_cluster.cc:1428] Setting key 686a914bdcdf54bd915361f07e567ed8
Sep 24 12:53:05 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254385, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:05.856510 17800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:05.830193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:52309 (local address 127.11.49.126:40841)
0924 12:53:05.832061 (+ 1868us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:05.832068 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:05.832973 (+ 905us) server_negotiation.cc:407] Connection header received
0924 12:53:05.835893 (+ 2920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:05.835899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:05.836004 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:05.836168 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:05.838658 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:05.839581 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:05.841949 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:05.842765 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:05.842984 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:05.847610 (+ 4626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:05.847621 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:05.847629 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:05.847712 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:05.851947 (+ 4235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:05.853044 (+ 1097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:05.853054 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:05.853060 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:05.853306 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:05.853904 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:05.853912 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:05.853918 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:05.854486 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:05.854683 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:05.855528 (+ 845us) server_negotiation.cc:299] Negotiation successful
0924 12:53:05.855893 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1723,"thread_start_us":1596,"threads_started":1}
I20260924 12:53:05.857024 17801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:05.831269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.65:52309)
0924 12:53:05.832806 (+ 1537us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:05.832863 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:05.835452 (+ 2589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:05.836589 (+ 1137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:05.836604 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:05.837531 (+ 927us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:05.838402 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:05.838429 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:05.839806 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:05.839815 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:05.841701 (+ 1886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:05.841719 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:05.843095 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:05.843101 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:05.843337 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:05.844366 (+ 1029us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:05.844396 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:05.847206 (+ 2810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:05.852188 (+ 4982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:05.852196 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:05.852212 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:05.852844 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:05.853472 (+ 628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:05.853476 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:05.853478 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:05.853745 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:05.854671 (+ 926us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:05.854677 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:05.855045 (+ 368us) client_negotiation.cc:769] Sending connection context
0924 12:53:05.855303 (+ 258us) client_negotiation.cc:240] Negotiation successful
0924 12:53:05.855789 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1211,"thread_start_us":907,"threads_started":1}
WARNING: no policy specified for oryx/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:53:05.859062 17798 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40841
I20260924 12:53:05.859396 17798 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:05.860221 17798 heartbeater.cc:511] Master 127.11.49.126:40841 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.66@KRBTEST.COM" created.
I20260924 12:53:05.862843 17609 ts_manager.cc:194] Registered new tserver with Master: 12dfc0d55448464ab20e07e9de4d07ac (127.11.49.65:38009)
I20260924 12:53:05.865025 17609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:52309
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab.
Entry for principal oryx/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab.
I20260924 12:53:05.892690 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40841
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab
--principal=oryx/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:06.321532 17804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:06.321962 17804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:06.322162 17804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:06.331019 17804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:06.331200 17804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:06.331439 17804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:53:06.343299 17804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab
--principal=oryx/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40841
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:06.345579 17804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:06.347544 17804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:06.365566 17809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:06.365666 17810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:06.365625 17812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:06.366921 17804 server_base.cc:1034] running on GCE node
I20260924 12:53:06.367777 17804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:06.369123 17804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:06.370431 17804 hybrid_clock.cc:648] HybridClock initialized: now 1790254386370346 us; error 83 us; skew 500 ppm
I20260924 12:53:06.370905 17804 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:06 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254386, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:06.374794 17804 init.cc:377] Logged in from keytab as oryx/127.11.49.66@KRBTEST.COM (short username oryx)
I20260924 12:53:06.376871 17804 webserver.cc:460] Webserver started at http://127.11.49.66:36455/ using document root <none> and password file <none>
I20260924 12:53:06.377825 17804 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:06.377987 17804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:06.378324 17804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:06.381819 17804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "218e5d98186f4b40a3e8f31efba815f8"
format_stamp: "Formatted at 2026-09-24 12:53:06 on dist-test-slave-m9hg"
server_key: "bfb47a443e48646d5676cb0598ce37ab"
server_key_iv: "bb0aebec232aa5e3f61930712f9b9ba9"
server_key_version: "encryptionkey@0"
I20260924 12:53:06.382786 17804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "218e5d98186f4b40a3e8f31efba815f8"
format_stamp: "Formatted at 2026-09-24 12:53:06 on dist-test-slave-m9hg"
server_key: "bfb47a443e48646d5676cb0598ce37ab"
server_key_iv: "bb0aebec232aa5e3f61930712f9b9ba9"
server_key_version: "encryptionkey@0"
I20260924 12:53:06.389117 17804 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260924 12:53:06.393955 17819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:06.396302 17804 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260924 12:53:06.396587 17804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "218e5d98186f4b40a3e8f31efba815f8"
format_stamp: "Formatted at 2026-09-24 12:53:06 on dist-test-slave-m9hg"
server_key: "bfb47a443e48646d5676cb0598ce37ab"
server_key_iv: "bb0aebec232aa5e3f61930712f9b9ba9"
server_key_version: "encryptionkey@0"
I20260924 12:53:06.396855 17804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:06.410677 17804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:06.415503 17804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:06.415854 17804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:06.417060 17804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:06.418679 17804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:06.418797 17804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:06.418953 17804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:06.419028 17804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:06.460983 17804 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:33793
I20260924 12:53:06.461026 17931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:33793 every 8 connection(s)
I20260924 12:53:06.462622 17804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:53:06.472004 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 17804
I20260924 12:53:06.472301 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:53:06.473007 11461 external_mini_cluster.cc:1428] Setting key 959e506e14624e477c5ce12fb2e41d81
Sep 24 12:53:06 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254386, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:06.491575 17934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:06.466198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:38133 (local address 127.11.49.126:40841)
0924 12:53:06.466806 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:06.466812 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:06.467948 (+ 1136us) server_negotiation.cc:407] Connection header received
0924 12:53:06.470370 (+ 2422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:06.470378 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:06.470513 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:06.470657 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:06.473619 (+ 2962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:06.474650 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:06.477363 (+ 2713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:06.478220 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:06.478400 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:06.483952 (+ 5552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:06.483958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:06.483962 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:06.484008 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:06.487196 (+ 3188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:06.488635 (+ 1439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:06.488640 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:06.488643 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:06.488807 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:06.489438 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:06.489442 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:06.489444 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:06.489749 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:06.489897 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:06.491078 (+ 1181us) server_negotiation.cc:299] Negotiation successful
0924 12:53:06.491300 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":330,"threads_started":1}
I20260924 12:53:06.493685 17935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:06.466822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.66:38133)
0924 12:53:06.467710 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:06.467772 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:06.469943 (+ 2171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:06.471002 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:06.471014 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:06.471988 (+ 974us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:06.473253 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:06.473292 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:06.474878 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:06.474885 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:06.477098 (+ 2213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:06.477133 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:06.478535 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:06.478542 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:06.478829 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:06.479890 (+ 1061us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:06.479921 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:06.483537 (+ 3616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:06.487472 (+ 3935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:06.487488 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:06.487518 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:06.488433 (+ 915us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:06.488949 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:06.488957 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:06.488963 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:06.489299 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:06.489908 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:06.489921 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:06.490555 (+ 634us) client_negotiation.cc:769] Sending connection context
0924 12:53:06.490962 (+ 407us) client_negotiation.cc:240] Negotiation successful
0924 12:53:06.491768 (+ 806us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":335,"threads_started":1}
I20260924 12:53:06.495914 17932 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40841
I20260924 12:53:06.496486 17932 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:06.497448 17932 heartbeater.cc:511] Master 127.11.49.126:40841 requested a full tablet report, sending...
I20260924 12:53:06.499732 17609 ts_manager.cc:194] Registered new tserver with Master: 218e5d98186f4b40a3e8f31efba815f8 (127.11.49.66:33793)
WARNING: no policy specified for oryx/127.11.49.67@KRBTEST.COM; defaulting to no policy
I20260924 12:53:06.501385 17609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:38133
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab.
Entry for principal oryx/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab.
I20260924 12:53:06.536178 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40841
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab
--principal=oryx/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:53:06.869650 17798 heartbeater.cc:503] Master 127.11.49.126:40841 was elected leader, sending a full tablet report...
W20260924 12:53:06.900833 17938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:06.901139 17938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:06.901289 17938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:06.908929 17938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:06.909068 17938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:06.909231 17938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:53:06.919528 17938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab
--principal=oryx/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40841
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:06.920987 17938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:06.922322 17938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:06.939340 17944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:06.939484 17943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:06.939714 17946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:06.941362 17938 server_base.cc:1034] running on GCE node
I20260924 12:53:06.942333 17938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:06.943679 17938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:06.945065 17938 hybrid_clock.cc:648] HybridClock initialized: now 1790254386944983 us; error 59 us; skew 500 ppm
I20260924 12:53:06.945534 17938 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:06 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254386, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:06.949951 17938 init.cc:377] Logged in from keytab as oryx/127.11.49.67@KRBTEST.COM (short username oryx)
I20260924 12:53:06.952376 17938 webserver.cc:460] Webserver started at http://127.11.49.67:34191/ using document root <none> and password file <none>
I20260924 12:53:06.953332 17938 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:06.953516 17938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:06.953913 17938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:06.957891 17938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "9cdad6dae8934f2cbee30e01112c39df"
format_stamp: "Formatted at 2026-09-24 12:53:06 on dist-test-slave-m9hg"
server_key: "363a8490299789ee90bf5dd051212bb7"
server_key_iv: "31d93d2fba0d92149ff66c88be4da5fa"
server_key_version: "encryptionkey@0"
I20260924 12:53:06.959030 17938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "9cdad6dae8934f2cbee30e01112c39df"
format_stamp: "Formatted at 2026-09-24 12:53:06 on dist-test-slave-m9hg"
server_key: "363a8490299789ee90bf5dd051212bb7"
server_key_iv: "31d93d2fba0d92149ff66c88be4da5fa"
server_key_version: "encryptionkey@0"
I20260924 12:53:06.966706 17938 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260924 12:53:06.971895 17953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:06.974027 17938 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260924 12:53:06.974329 17938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "9cdad6dae8934f2cbee30e01112c39df"
format_stamp: "Formatted at 2026-09-24 12:53:06 on dist-test-slave-m9hg"
server_key: "363a8490299789ee90bf5dd051212bb7"
server_key_iv: "31d93d2fba0d92149ff66c88be4da5fa"
server_key_version: "encryptionkey@0"
I20260924 12:53:06.974653 17938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:07.003028 17938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:07.009402 17938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:07.009819 17938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:07.011125 17938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:07.012981 17938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:07.013095 17938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:07.013257 17938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:07.013330 17938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:07.054875 17938 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:43695
I20260924 12:53:07.054991 18065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:43695 every 8 connection(s)
I20260924 12:53:07.056600 17938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:53:07.063880 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 17938
I20260924 12:53:07.064162 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:53:07.064751 11461 external_mini_cluster.cc:1428] Setting key 1c10aeba03bda3c4ba9577fa7b0b019d
Sep 24 12:53:07 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254386, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:07.084789 18068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.059940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:35493 (local address 127.11.49.126:40841)
0924 12:53:07.060591 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:07.060599 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:07.062002 (+ 1403us) server_negotiation.cc:407] Connection header received
0924 12:53:07.064586 (+ 2584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:07.064593 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:07.064703 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:07.064856 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:07.066893 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.068029 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.070306 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.070743 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.070870 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.075908 (+ 5038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:07.075914 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:07.075918 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:07.075966 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:07.079977 (+ 4011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.081357 (+ 1380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.081366 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.081377 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.081621 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.082349 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.082355 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.082359 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.082744 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:07.082939 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:07.083896 (+ 957us) server_negotiation.cc:299] Negotiation successful
0924 12:53:07.084206 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":279,"threads_started":1}
I20260924 12:53:07.086149 18069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.060844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.67:35493)
0924 12:53:07.061796 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:07.061853 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:07.064142 (+ 2289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:07.065128 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:07.065137 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:07.065880 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:07.066698 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.066727 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.068339 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.068351 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.070090 (+ 1739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.070115 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.071081 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.071089 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.071386 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.072420 (+ 1034us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:07.072455 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:07.075560 (+ 3105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:07.080251 (+ 4691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.080264 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.080323 (+ 59us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.081142 (+ 819us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.081787 (+ 645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.081807 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.081810 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.082202 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.082901 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:07.082912 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:07.083435 (+ 523us) client_negotiation.cc:769] Sending connection context
0924 12:53:07.083788 (+ 353us) client_negotiation.cc:240] Negotiation successful
0924 12:53:07.084563 (+ 775us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":362,"threads_started":1}
I20260924 12:53:07.088249 18066 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40841
I20260924 12:53:07.088775 18066 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:07.089798 18066 heartbeater.cc:511] Master 127.11.49.126:40841 requested a full tablet report, sending...
I20260924 12:53:07.091943 17609 ts_manager.cc:194] Registered new tserver with Master: 9cdad6dae8934f2cbee30e01112c39df (127.11.49.67:43695)
I20260924 12:53:07.093066 17609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:35493
I20260924 12:53:07.095842 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.49.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.125.keytab.
Entry for principal oryx/127.11.49.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.125.keytab.
I20260924 12:53:07.157119 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.125:45967
--webserver_interface=127.11.49.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.125.keytab
--principal=oryx/127.11.49.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:40841,127.11.49.125:45967
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:53:07.506130 17932 heartbeater.cc:503] Master 127.11.49.126:40841 was elected leader, sending a full tablet report...
W20260924 12:53:07.529671 18072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:07.530134 18072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:07.530313 18072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:07.539785 18072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:53:07.540010 18072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:07.540136 18072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:07.540241 18072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:53:07.540367 18072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:53:07.552505 18072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:40841,127.11.49.125:45967
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.125.keytab
--principal=oryx/127.11.49.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.125:45967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.49.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
W20260924 12:53:07.553054 18072 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.49.126:40841,127.11.49.125:45967'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260924 12:53:07.554585 18072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:07.556420 18072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:07.570560 18077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:07.571851 18078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:07.572645 18080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:07.573067 18072 server_base.cc:1034] running on GCE node
I20260924 12:53:07.574144 18072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:07.576097 18072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:07.577426 18072 hybrid_clock.cc:648] HybridClock initialized: now 1790254387577354 us; error 51 us; skew 500 ppm
I20260924 12:53:07.577929 18072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:07 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254387, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:07.582093 18072 init.cc:377] Logged in from keytab as oryx/127.11.49.125@KRBTEST.COM (short username oryx)
I20260924 12:53:07.586053 18072 webserver.cc:460] Webserver started at http://127.11.49.125:36619/ using document root <none> and password file <none>
I20260924 12:53:07.587131 18072 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:07.587301 18072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:07.587833 18072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:07.593294 18072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data/instance:
uuid: "502cf6b751b547f7b1cf2886aea65145"
format_stamp: "Formatted at 2026-09-24 12:53:07 on dist-test-slave-m9hg"
server_key: "7ed68af92b243a6be479116216fe2387"
server_key_iv: "cac2f782231197985202ff34eacc2737"
server_key_version: "encryptionkey@0"
I20260924 12:53:07.594951 18072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/wal/instance:
uuid: "502cf6b751b547f7b1cf2886aea65145"
format_stamp: "Formatted at 2026-09-24 12:53:07 on dist-test-slave-m9hg"
server_key: "7ed68af92b243a6be479116216fe2387"
server_key_iv: "cac2f782231197985202ff34eacc2737"
server_key_version: "encryptionkey@0"
I20260924 12:53:07.602906 18072 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260924 12:53:07.608319 18087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:07.610544 18072 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260924 12:53:07.610884 18072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/wal
uuid: "502cf6b751b547f7b1cf2886aea65145"
format_stamp: "Formatted at 2026-09-24 12:53:07 on dist-test-slave-m9hg"
server_key: "7ed68af92b243a6be479116216fe2387"
server_key_iv: "cac2f782231197985202ff34eacc2737"
server_key_version: "encryptionkey@0"
I20260924 12:53:07.611223 18072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:07.633476 18072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:07.639290 18072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:07.639686 18072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:07.663041 18072 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.125:45967
I20260924 12:53:07.663054 18138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.125:45967 every 8 connection(s)
I20260924 12:53:07.664989 18072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
I20260924 12:53:07.669348 18139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:07.669667 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 18072
I20260924 12:53:07.680629 18139 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:53:07 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.49.125@KRBTEST.COM
Sep 24 12:53:07 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254387, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.125@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:07.698787 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.672587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50848 (local address 127.11.49.125:45967)
0924 12:53:07.673786 (+ 1199us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:07.673805 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:07.673866 (+ 61us) server_negotiation.cc:407] Connection header received
0924 12:53:07.676582 (+ 2716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:07.676624 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:07.677626 (+ 1002us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:07.678535 (+ 909us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:07.681133 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.682895 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.684666 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.685860 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.686089 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.690407 (+ 4318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:07.690417 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:07.690430 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:07.690479 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:07.693885 (+ 3406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.694717 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.694723 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.694731 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.694933 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.695384 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.695388 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.695391 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.696111 (+ 720us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:07.696519 (+ 408us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:07.697162 (+ 643us) server_negotiation.cc:299] Negotiation successful
0924 12:53:07.697682 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":872,"thread_start_us":549,"threads_started":1}
I20260924 12:53:07.703121 18143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.683799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:57874)
0924 12:53:07.685238 (+ 1439us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:07.685303 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:07.685507 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:07.686127 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:07.686138 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:07.687070 (+ 932us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:07.687398 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.687409 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.688735 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.688743 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.690019 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.690033 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.690874 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.690880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.691117 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.691924 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:07.691948 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:07.694896 (+ 2948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:07.699214 (+ 4318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.699243 (+ 29us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.699251 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.699833 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.700381 (+ 548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.700388 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.700392 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.700618 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.702109 (+ 1491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:07.702119 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:07.702312 (+ 193us) client_negotiation.cc:769] Sending connection context
0924 12:53:07.702481 (+ 169us) client_negotiation.cc:240] Negotiation successful
0924 12:53:07.702824 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1136,"thread_start_us":941,"threads_started":1}
I20260924 12:53:07.703244 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.683876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57874 (local address 127.11.49.126:40841)
0924 12:53:07.684710 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:07.684716 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:07.685479 (+ 763us) server_negotiation.cc:407] Connection header received
0924 12:53:07.685687 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:07.685694 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:07.685822 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:07.686036 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:07.687600 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.688576 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.690189 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.690639 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.690796 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.695222 (+ 4426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:07.695228 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:07.695232 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:07.695283 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:07.699008 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.699989 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.699998 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.700005 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.700199 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.700822 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.700829 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.700832 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.701485 (+ 653us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:07.701845 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:07.702612 (+ 767us) server_negotiation.cc:299] Negotiation successful
0924 12:53:07.702879 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":509,"threads_started":1}
I20260924 12:53:07.704988 18139 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:53:07 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254387, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.125@KRBTEST.COM for oryx/127.11.49.125@KRBTEST.COM
I20260924 12:53:07.720263 18143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.705597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:45967 (local address 127.0.0.1:50858)
0924 12:53:07.705873 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:07.705903 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:07.706095 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:07.706408 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:07.706412 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:07.706861 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:07.707021 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.707030 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.708103 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.708109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.709118 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.709131 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.709934 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.709939 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.710146 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.710961 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:07.710983 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:07.713694 (+ 2711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:07.717440 (+ 3746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.717446 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.717450 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.718010 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.718478 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.718482 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.718484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.718645 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.719237 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:07.719242 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:07.719454 (+ 212us) client_negotiation.cc:769] Sending connection context
0924 12:53:07.719601 (+ 147us) client_negotiation.cc:240] Negotiation successful
0924 12:53:07.719955 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260924 12:53:07.720683 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.705926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50858 (local address 127.11.49.125:45967)
0924 12:53:07.706128 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:07.706136 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:07.706160 (+ 24us) server_negotiation.cc:407] Connection header received
0924 12:53:07.706212 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:07.706217 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:07.706282 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:07.706389 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:07.707171 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.707947 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.709267 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.709724 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.709899 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.714025 (+ 4126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:07.714032 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:07.714036 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:07.714085 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:07.717206 (+ 3121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.718175 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.718180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.718183 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.718348 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.718770 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.718774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.718776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.719088 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:07.719221 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:07.719758 (+ 537us) server_negotiation.cc:299] Negotiation successful
0924 12:53:07.720128 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":136,"server-negotiator.queue_time_us":96}
I20260924 12:53:07.726174 18139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: Bootstrap starting.
I20260924 12:53:07.729730 18139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:07.730877 18139 log.cc:824] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:07.734120 18139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: No bootstrap required, opened a new log
I20260924 12:53:07.742105 18139 raft_consensus.cc:348] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } }
I20260924 12:53:07.742472 18139 raft_consensus.cc:374] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:07.742545 18139 raft_consensus.cc:729] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502cf6b751b547f7b1cf2886aea65145, State: Initialized, Role: FOLLOWER
I20260924 12:53:07.743160 18139 consensus_queue.cc:260] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } }
I20260924 12:53:07.744109 18146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } } }
I20260924 12:53:07.744604 18146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:53:07.745385 18139 sys_catalog.cc:564] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: configured and running, proceeding with master startup.
W20260924 12:53:07.758136 18157 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 12:53:07.758366 18157 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 12:53:07.764531 18072 master_runner.cc:428] Detected that this master 502cf6b751b547f7b1cf2886aea65145 is joining an existing cluster
I20260924 12:53:07.764704 18072 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.49.125:45967
WARNING: no policy specified for oryx/127.11.49.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.124@KRBTEST.COM" created.
I20260924 12:53:07.791669 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.769368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57876 (local address 127.11.49.126:40841)
0924 12:53:07.769679 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:07.769688 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:07.770437 (+ 749us) server_negotiation.cc:407] Connection header received
0924 12:53:07.770768 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:07.770775 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:07.770889 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:07.770990 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:07.773651 (+ 2661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.775365 (+ 1714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.778603 (+ 3238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.779644 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.779786 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.782664 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:07.782672 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:07.782688 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:07.782732 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:07.788088 (+ 5356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.789149 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.789156 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.789162 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.789335 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.789856 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.789861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.789865 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.790298 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:07.790490 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:07.790997 (+ 507us) server_negotiation.cc:299] Negotiation successful
0924 12:53:07.791272 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260924 12:53:07.791812 18164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.769427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:57876)
0924 12:53:07.770293 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:07.770324 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:07.770578 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:07.771590 (+ 1012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:07.771598 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:07.772821 (+ 1223us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:07.773399 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.773417 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.775683 (+ 2266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.775689 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.778352 (+ 2663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.778375 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.780249 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.780260 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.780582 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.781448 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:07.781472 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:07.782434 (+ 962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:07.788318 (+ 5884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.788328 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.788336 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.788971 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.789481 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.789490 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.789497 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.789696 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.790443 (+ 747us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:07.790448 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:07.790665 (+ 217us) client_negotiation.cc:769] Sending connection context
0924 12:53:07.790873 (+ 208us) client_negotiation.cc:240] Negotiation successful
0924 12:53:07.791286 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":479,"threads_started":1}
I20260924 12:53:07.801777 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.770855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50866 (local address 127.11.49.125:45967)
0924 12:53:07.771417 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:07.771426 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:07.783006 (+ 11580us) server_negotiation.cc:407] Connection header received
0924 12:53:07.783288 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:07.783296 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:07.783385 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:07.783478 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:07.785217 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.786046 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.788358 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.789208 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.789315 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.793555 (+ 4240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:07.793561 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:07.793566 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:07.793606 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:07.797982 (+ 4376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.798914 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.798919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.798923 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.799102 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.799548 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.799553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.799556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.799955 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:07.800101 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:07.800789 (+ 688us) server_negotiation.cc:299] Negotiation successful
0924 12:53:07.801144 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337}
I20260924 12:53:07.803499 18165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.770519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:45967 (local address 127.0.0.1:50866)
0924 12:53:07.782899 (+ 12380us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:07.782932 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:07.783104 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:07.783714 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:07.783722 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:07.784543 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:07.785058 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.785071 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.786262 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.786271 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.788155 (+ 1884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.788173 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.789648 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.789654 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.789884 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.792137 (+ 2253us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:07.792164 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:07.793341 (+ 1177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:07.798137 (+ 4796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.798142 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.798146 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.798776 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.799257 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.799261 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.799264 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.799432 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.800191 (+ 759us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:07.800196 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:07.800389 (+ 193us) client_negotiation.cc:769] Sending connection context
0924 12:53:07.802285 (+ 1896us) client_negotiation.cc:240] Negotiation successful
0924 12:53:07.802729 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12205,"thread_start_us":10831,"threads_started":1}
Sep 24 12:53:07 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254384, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.126@KRBTEST.COM for oryx/127.11.49.125@KRBTEST.COM
I20260924 12:53:07.820847 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.800787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50874 (local address 127.11.49.125:45967)
0924 12:53:07.802230 (+ 1443us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:07.802239 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:07.804496 (+ 2257us) server_negotiation.cc:407] Connection header received
0924 12:53:07.804925 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:07.804931 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:07.805036 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:07.805122 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:07.806623 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.807899 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.809515 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.810165 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.810327 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.814028 (+ 3701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:07.814033 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:07.814037 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:07.814071 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:07.817635 (+ 3564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.818470 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.818477 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.818481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.818636 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.819075 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.819081 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.819084 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.819434 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:07.819627 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:07.820112 (+ 485us) server_negotiation.cc:299] Negotiation successful
0924 12:53:07.820398 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1289,"thread_start_us":6644,"threads_started":1}
I20260924 12:53:07.820902 18167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.800172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:45967 (local address 127.0.0.1:50874)
0924 12:53:07.804343 (+ 4171us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:07.804382 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:07.804650 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:07.805402 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:07.805409 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:07.806118 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:07.806356 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.806405 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.808061 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.808068 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.809353 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.809366 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.810347 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.810353 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.810588 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.811361 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:07.811381 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:07.813802 (+ 2421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:07.817876 (+ 4074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.817888 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.817894 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.818325 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.818767 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.818774 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.818778 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.818948 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.819611 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:07.819620 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:07.819799 (+ 179us) client_negotiation.cc:769] Sending connection context
0924 12:53:07.820003 (+ 204us) client_negotiation.cc:240] Negotiation successful
0924 12:53:07.820403 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3866,"thread_start_us":3688,"threads_started":1}
I20260924 12:53:07.823410 17609 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.49.125:45967: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "502cf6b751b547f7b1cf2886aea65145"
member_type: NON_VOTER
last_known_addr {
host: "127.11.49.125"
port: 45967
}
attrs {
promote: true
}
}
dest_uuid: "7948b76170d6434aad3f4d489ee0b03d"
cas_config_opid_index: -1
I20260924 12:53:07.824695 17609 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } }
I20260924 12:53:07.830463 18171 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 502cf6b751b547f7b1cf2886aea65145 (127.11.49.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } } }
I20260924 12:53:07.832808 18114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 0 FOLLOWER]: Advancing to term 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.124.keytab.
Entry for principal oryx/127.11.49.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.124.keytab.
I20260924 12:53:07.835778 18171 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.49.125:45967
I20260924 12:53:07.836340 18171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } } }
I20260924 12:53:07.836568 18171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:07.836737 18072 master.cc:537] Master@127.11.49.125:45967 shutting down...
I20260924 12:53:07.837951 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.124:36189
--webserver_interface=127.11.49.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.124.keytab
--principal=oryx/127.11.49.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:40841,127.11.49.125:45967,127.11.49.124:36189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:53:07.842720 18114 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Refusing update from remote peer 7948b76170d6434aad3f4d489ee0b03d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260924 12:53:07.848611 18170 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [LEADER]: Connected to new peer: Peer: permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260924 12:53:07.853435 17595 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260924 12:53:07.859473 18072 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:07.860131 18072 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:07.860371 18072 tablet_replica.cc:330] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: stopping tablet replica
W20260924 12:53:07.860693 17595 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d -> Peer 502cf6b751b547f7b1cf2886aea65145 (127.11.49.125:45967): Couldn't send request to peer 502cf6b751b547f7b1cf2886aea65145. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260924 12:53:07.869290 18072 master.cc:552] Master@127.11.49.125:45967 shutdown complete.
I20260924 12:53:07.869405 18072 master_runner.cc:305] Clearing existing system tablet
I20260924 12:53:07.869839 18072 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:07.869946 18072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:07.873346 18072 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260924 12:53:07.875821 18176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:07.876415 18072 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:07.876801 18072 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260924 12:53:07.876921 18072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/wal
uuid: "502cf6b751b547f7b1cf2886aea65145"
format_stamp: "Formatted at 2026-09-24 12:53:07 on dist-test-slave-m9hg"
server_key: "7ed68af92b243a6be479116216fe2387"
server_key_iv: "cac2f782231197985202ff34eacc2737"
server_key_version: "encryptionkey@0"
I20260924 12:53:07.884234 18072 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:07.893736 18072 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260924 12:53:07.894102 18072 log.cc:1196] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260924 12:53:07.894690 18072 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: Deleting consensus metadata
I20260924 12:53:07.895061 18072 master_runner.cc:315] Copying system tablet from 127.11.49.126:40841
I20260924 12:53:07.898711 18072 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: tablet copy: Beginning tablet copy session from remote peer at address 127.11.49.126:40841
I20260924 12:53:07.922219 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.899844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:57888)
0924 12:53:07.904969 (+ 5125us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:07.905005 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:07.905270 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:07.905793 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:07.905798 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:07.906599 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:07.907105 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.907123 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.908803 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.908810 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.910416 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:07.910435 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.911669 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.911675 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:07.911886 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.912832 (+ 946us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:07.912855 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:07.913991 (+ 1136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:07.918764 (+ 4773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.918771 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.918776 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.919389 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.919974 (+ 585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:07.919979 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:07.919984 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:07.920187 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:07.920955 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:07.920960 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:07.921179 (+ 219us) client_negotiation.cc:769] Sending connection context
0924 12:53:07.921356 (+ 177us) client_negotiation.cc:240] Negotiation successful
0924 12:53:07.921688 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4906,"thread_start_us":4687,"threads_started":1}
I20260924 12:53:07.922318 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:07.899950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57888 (local address 127.11.49.126:40841)
0924 12:53:07.900192 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:07.900199 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:07.905210 (+ 5011us) server_negotiation.cc:407] Connection header received
0924 12:53:07.905446 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:07.905453 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:07.905572 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:07.905733 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:07.907390 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.908577 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.910701 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:07.911464 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:07.911633 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:07.914346 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:07.914355 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:07.914361 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:07.914423 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:07.918513 (+ 4090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.919578 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.919585 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.919589 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.919811 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:07.920361 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:07.920366 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:07.920369 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:07.920797 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:07.920979 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:07.921550 (+ 571us) server_negotiation.cc:299] Negotiation successful
0924 12:53:07.921891 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260924 12:53:07.923851 17629 tablet_copy_service.cc:140] P 7948b76170d6434aad3f4d489ee0b03d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 502cf6b751b547f7b1cf2886aea65145 ({username='oryx', principal='oryx/127.11.49.125@KRBTEST.COM'} at 127.0.0.1:57888)
I20260924 12:53:07.924259 17629 tablet_copy_service.cc:161] P 7948b76170d6434aad3f4d489ee0b03d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 502cf6b751b547f7b1cf2886aea65145 at {username='oryx', principal='oryx/127.11.49.125@KRBTEST.COM'} at 127.0.0.1:57888: session id = 502cf6b751b547f7b1cf2886aea65145-00000000000000000000000000000000
I20260924 12:53:07.929539 17629 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d: Tablet Copy: opened 0 blocks and 1 log segments
I20260924 12:53:07.932799 18072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260924 12:53:07.940371 18072 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: tablet copy: Starting download of 0 data blocks...
I20260924 12:53:07.940757 18072 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: tablet copy: Starting download of 1 WAL segments...
I20260924 12:53:07.944741 18072 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260924 12:53:07.951119 17629 tablet_copy_service.cc:342] P 7948b76170d6434aad3f4d489ee0b03d: Request end of tablet copy session 502cf6b751b547f7b1cf2886aea65145-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.49.125@KRBTEST.COM'} at 127.0.0.1:57888
I20260924 12:53:07.951458 17629 tablet_copy_service.cc:433] P 7948b76170d6434aad3f4d489ee0b03d: ending tablet copy session 502cf6b751b547f7b1cf2886aea65145-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 502cf6b751b547f7b1cf2886aea65145
I20260924 12:53:07.967677 18072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:07.971211 18183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:07.972119 18184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:07.977144 18186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:07.977824 18072 server_base.cc:1034] running on GCE node
I20260924 12:53:07.978405 18072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:07.979164 18072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:07.980508 18072 hybrid_clock.cc:648] HybridClock initialized: now 1790254387980360 us; error 86 us; skew 500 ppm
I20260924 12:53:07.980860 18072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:07 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254387, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:07.983616 18072 init.cc:377] Logged in from keytab as oryx/127.11.49.125@KRBTEST.COM (short username oryx)
I20260924 12:53:07.985407 18072 webserver.cc:460] Webserver started at http://127.11.49.125:34395/ using document root <none> and password file <none>
I20260924 12:53:07.985949 18072 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:07.986048 18072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:07.989974 18072 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260924 12:53:07.992805 18193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:07.993391 18072 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260924 12:53:07.993599 18072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/wal
uuid: "502cf6b751b547f7b1cf2886aea65145"
format_stamp: "Formatted at 2026-09-24 12:53:07 on dist-test-slave-m9hg"
server_key: "7ed68af92b243a6be479116216fe2387"
server_key_iv: "cac2f782231197985202ff34eacc2737"
server_key_version: "encryptionkey@0"
I20260924 12:53:07.993805 18072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:08.029580 18072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:08.034631 18072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:08.096907 18066 heartbeater.cc:503] Master 127.11.49.126:40841 was elected leader, sending a full tablet report...
I20260924 12:53:08.124222 18072 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.125:45967
I20260924 12:53:08.124310 18244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.125:45967 every 8 connection(s)
I20260924 12:53:08.125559 18072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
I20260924 12:53:08.133746 18245 sys_catalog.cc:263] Verifying existing consensus state
I20260924 12:53:08.137037 18245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: Bootstrap starting.
I20260924 12:53:08.157007 18245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 12:53:08.157675 18245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: Bootstrap complete.
I20260924 12:53:08.158763 18245 raft_consensus.cc:348] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } }
I20260924 12:53:08.159075 18245 raft_consensus.cc:729] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 502cf6b751b547f7b1cf2886aea65145, State: Initialized, Role: LEARNER
I20260924 12:53:08.159354 18245 consensus_queue.cc:260] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } }
I20260924 12:53:08.160444 18248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } } }
I20260924 12:53:08.160840 18245 sys_catalog.cc:564] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:53:08.160972 18248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: This master's current role is: LEARNER
I20260924 12:53:08.172037 18259 catalog_manager.cc:1259] Loaded cluster ID: fbf514c5d25b49c68fa830f42d936032
I20260924 12:53:08.172216 18259 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: loading cluster ID for follower catalog manager: success
I20260924 12:53:08.175469 18259 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: acquiring CA information for follower catalog manager: success
I20260924 12:53:08.178378 18259 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260924 12:53:08.342628 18174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:08.343080 18174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:08.343261 18174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260924 12:53:08.349882 18263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.341571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:45967 (local address 127.0.0.1:50888)
0924 12:53:08.342322 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:08.342371 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:08.342597 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:08.343318 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:08.343323 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:08.343386 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:08.343644 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.343655 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.345624 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.345629 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.347055 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.347076 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.349060 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.349066 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.349244 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.349306 (+ 62us) client_negotiation.cc:769] Sending connection context
0924 12:53:08.349410 (+ 104us) client_negotiation.cc:240] Negotiation successful
0924 12:53:08.349550 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":362,"threads_started":1}
I20260924 12:53:08.349977 18264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.341990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50888 (local address 127.11.49.125:45967)
0924 12:53:08.342813 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:08.342820 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:08.342850 (+ 30us) server_negotiation.cc:407] Connection header received
0924 12:53:08.342938 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:08.342944 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:08.343055 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:08.343226 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:08.343860 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.345413 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.347275 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.348678 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.348843 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.349107 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:08.349467 (+ 360us) server_negotiation.cc:299] Negotiation successful
0924 12:53:08.349614 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":418,"threads_started":1}
I20260924 12:53:08.351550 18220 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260924 12:53:08.352288 18248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7948b76170d6434aad3f4d489ee0b03d. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } } }
I20260924 12:53:08.352573 18248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: This master's current role is: LEARNER
W20260924 12:53:08.353353 18174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:53:08.353451 18174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:08.353497 18174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:08.353557 18174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:53:08.353595 18174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:53:08.364879 18174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:40841,127.11.49.125:45967,127.11.49.124:36189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.124.keytab
--principal=oryx/127.11.49.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.124:36189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.49.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:08.366946 18174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:08.368842 18174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:08.384935 18266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:08.384919 18269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:08.384853 18267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:08.390252 18174 server_base.cc:1034] running on GCE node
I20260924 12:53:08.391471 18174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:08.393573 18174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:08.394879 18174 hybrid_clock.cc:648] HybridClock initialized: now 1790254388394803 us; error 67 us; skew 500 ppm
I20260924 12:53:08.395426 18174 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:08 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254388, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:08.399691 18174 init.cc:377] Logged in from keytab as oryx/127.11.49.124@KRBTEST.COM (short username oryx)
I20260924 12:53:08.402164 18174 webserver.cc:460] Webserver started at http://127.11.49.124:37737/ using document root <none> and password file <none>
I20260924 12:53:08.403157 18174 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:08.403335 18174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:08.403723 18174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:08.407557 18174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data/instance:
uuid: "8d41c37c4e4042948d4b1c813e179d9c"
format_stamp: "Formatted at 2026-09-24 12:53:08 on dist-test-slave-m9hg"
server_key: "a8e767417f8787a22133da7586dca625"
server_key_iv: "266ede8db9839030ed1b72b63a4de99d"
server_key_version: "encryptionkey@0"
I20260924 12:53:08.408659 18174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/wal/instance:
uuid: "8d41c37c4e4042948d4b1c813e179d9c"
format_stamp: "Formatted at 2026-09-24 12:53:08 on dist-test-slave-m9hg"
server_key: "a8e767417f8787a22133da7586dca625"
server_key_iv: "266ede8db9839030ed1b72b63a4de99d"
server_key_version: "encryptionkey@0"
I20260924 12:53:08.415606 18174 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260924 12:53:08.420672 18276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:08.422659 18174 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:53:08.423029 18174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/wal
uuid: "8d41c37c4e4042948d4b1c813e179d9c"
format_stamp: "Formatted at 2026-09-24 12:53:08 on dist-test-slave-m9hg"
server_key: "a8e767417f8787a22133da7586dca625"
server_key_iv: "266ede8db9839030ed1b72b63a4de99d"
server_key_version: "encryptionkey@0"
I20260924 12:53:08.423360 18174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:08.446945 18174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:08.453101 18174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:08.453509 18174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:08.477998 18174 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.124:36189
I20260924 12:53:08.478003 18327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.124:36189 every 8 connection(s)
I20260924 12:53:08.479885 18174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
I20260924 12:53:08.481972 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 18174
I20260924 12:53:08.485757 18328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:08.495781 18328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:53:08 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.49.124@KRBTEST.COM
I20260924 12:53:08.511080 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.484832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60046 (local address 127.11.49.124:36189)
0924 12:53:08.485792 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:08.485806 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:08.485853 (+ 47us) server_negotiation.cc:407] Connection header received
0924 12:53:08.487616 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:08.487641 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:08.488080 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:08.488608 (+ 528us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:08.490319 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.491727 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.493102 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.493811 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.494044 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.499382 (+ 5338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:08.499401 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:08.499427 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:08.499518 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:08.504836 (+ 5318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.505709 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.505719 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.505731 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.506038 (+ 307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.506486 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.506492 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.506496 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.507399 (+ 903us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:08.507711 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:08.508410 (+ 699us) server_negotiation.cc:299] Negotiation successful
0924 12:53:08.509030 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":710,"thread_start_us":459,"threads_started":1}
Sep 24 12:53:08 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254388, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.124@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:08.520262 18332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.499895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57898 (local address 127.11.49.126:40841)
0924 12:53:08.501045 (+ 1150us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:08.501054 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:08.501276 (+ 222us) server_negotiation.cc:407] Connection header received
0924 12:53:08.501542 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:08.501558 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:08.501677 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:08.501858 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:08.503516 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.504824 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.507158 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.507753 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.507924 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.513445 (+ 5521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:08.513451 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:08.513455 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:08.513493 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:08.516933 (+ 3440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.518037 (+ 1104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.518042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.518044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.518178 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.518679 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.518682 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.518684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.519014 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:08.519148 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:08.519804 (+ 656us) server_negotiation.cc:299] Negotiation successful
0924 12:53:08.519985 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":385,"threads_started":1}
I20260924 12:53:08.520682 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.499690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:57898)
0924 12:53:08.501101 (+ 1411us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:08.501149 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:08.501363 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:08.501945 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:08.501951 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:08.502965 (+ 1014us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:08.503297 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.503312 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.505110 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.505115 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.506908 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.506923 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.508041 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.508053 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.508345 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.509539 (+ 1194us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:08.509565 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:08.513173 (+ 3608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:08.517146 (+ 3973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.517163 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.517170 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.517863 (+ 693us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.518331 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.518346 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.518349 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.518544 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.519185 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:08.519194 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:08.519461 (+ 267us) client_negotiation.cc:769] Sending connection context
0924 12:53:08.519682 (+ 221us) client_negotiation.cc:240] Negotiation successful
0924 12:53:08.520121 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1082,"thread_start_us":881,"threads_started":1}
I20260924 12:53:08.522621 18328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:53:08 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254388, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.124@KRBTEST.COM for oryx/127.11.49.125@KRBTEST.COM
I20260924 12:53:08.539228 18264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.523848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50894 (local address 127.11.49.125:45967)
0924 12:53:08.524108 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:08.524116 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:08.524149 (+ 33us) server_negotiation.cc:407] Connection header received
0924 12:53:08.524219 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:08.524224 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:08.524388 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:08.524533 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:08.525445 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.526288 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.527807 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.528388 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.528557 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.532759 (+ 4202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:08.532767 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:08.532772 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:08.532831 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:08.535884 (+ 3053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.536989 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.536995 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.536997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.537192 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.537658 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.537666 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.537668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.538075 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:08.538256 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:08.538623 (+ 367us) server_negotiation.cc:299] Negotiation successful
0924 12:53:08.538874 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260924 12:53:08.539258 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.523482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:45967 (local address 127.0.0.1:50894)
0924 12:53:08.523761 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:08.523783 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:08.523971 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:08.524564 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:08.524570 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:08.525063 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:08.525248 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.525258 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.526470 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.526477 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.527562 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.527577 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.528586 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.528593 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.528821 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.529680 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:08.529703 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:08.532432 (+ 2729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:08.536147 (+ 3715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.536152 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.536155 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.536789 (+ 634us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.537316 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.537319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.537321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.537492 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.538197 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:08.538201 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:08.538361 (+ 160us) client_negotiation.cc:769] Sending connection context
0924 12:53:08.538505 (+ 144us) client_negotiation.cc:240] Negotiation successful
0924 12:53:08.538856 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97}
I20260924 12:53:08.540508 18328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:53:08 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254388, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.124@KRBTEST.COM for oryx/127.11.49.124@KRBTEST.COM
I20260924 12:53:08.553723 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.541386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:36189 (local address 127.0.0.1:60058)
0924 12:53:08.541649 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:08.541668 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:08.541796 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:08.542111 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:08.542115 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:08.542506 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:08.542679 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.542687 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.543637 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.543645 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.544558 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.544569 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.545229 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.545235 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.545406 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.546025 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:08.546042 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:08.548092 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:08.551236 (+ 3144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.551244 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.551248 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.551588 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.552041 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.552044 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.552046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.552176 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.552709 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:08.552714 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:08.552858 (+ 144us) client_negotiation.cc:769] Sending connection context
0924 12:53:08.552999 (+ 141us) client_negotiation.cc:240] Negotiation successful
0924 12:53:08.553279 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260924 12:53:08.553800 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.541704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60058 (local address 127.11.49.124:36189)
0924 12:53:08.541894 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:08.541905 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:08.541917 (+ 12us) server_negotiation.cc:407] Connection header received
0924 12:53:08.541948 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:08.541951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:08.541997 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:08.542097 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:08.542818 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.543515 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.544693 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.545065 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.545191 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.548327 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:08.548334 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:08.548339 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:08.548372 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:08.551102 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.551711 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.551718 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.551721 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.551866 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.552336 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.552340 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.552342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.552589 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:08.552738 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:08.553075 (+ 337us) server_negotiation.cc:299] Negotiation successful
0924 12:53:08.553433 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":140,"server-negotiator.queue_time_us":76}
I20260924 12:53:08.559049 18328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Bootstrap starting.
I20260924 12:53:08.562402 18328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:08.563690 18328 log.cc:824] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:08.567214 18328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: No bootstrap required, opened a new log
I20260924 12:53:08.574451 18328 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } }
I20260924 12:53:08.574781 18328 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:08.574854 18328 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d41c37c4e4042948d4b1c813e179d9c, State: Initialized, Role: FOLLOWER
I20260924 12:53:08.575479 18328 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } }
I20260924 12:53:08.576741 18335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } } }
I20260924 12:53:08.577296 18335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:53:08.577911 18328 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: configured and running, proceeding with master startup.
W20260924 12:53:08.589500 18346 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 12:53:08.589731 18346 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 12:53:08.595422 18174 master_runner.cc:428] Detected that this master 8d41c37c4e4042948d4b1c813e179d9c is joining an existing cluster
I20260924 12:53:08.595633 18174 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.49.124:36189
I20260924 12:53:08.619987 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 17670
I20260924 12:53:08.622816 18332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.600916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57914 (local address 127.11.49.126:40841)
0924 12:53:08.601185 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:08.601192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:08.602128 (+ 936us) server_negotiation.cc:407] Connection header received
0924 12:53:08.602479 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:08.602488 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:08.602595 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:08.602687 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:08.604309 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.605465 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.607652 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.608382 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.608501 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.611848 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:08.611860 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:08.611868 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:08.611924 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:08.616111 (+ 4187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.617154 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.617160 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.617164 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.619170 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.620491 (+ 1321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.620501 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.620504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.620960 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:08.621144 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:08.621996 (+ 852us) server_negotiation.cc:299] Negotiation successful
0924 12:53:08.622332 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260924 12:53:08.624456 18352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.600951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:57914)
0924 12:53:08.601989 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:08.602012 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:08.602291 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:08.602931 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:08.602938 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:08.603689 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:08.604080 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.604093 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.605734 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.605740 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.607459 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.607476 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.608835 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.608841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.609032 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.609869 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:08.609893 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:08.611481 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:08.616327 (+ 4846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.616333 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.616339 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.616984 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.619348 (+ 2364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.619353 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.619357 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.620298 (+ 941us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.621256 (+ 958us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:08.621262 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:08.621656 (+ 394us) client_negotiation.cc:769] Sending connection context
0924 12:53:08.623121 (+ 1465us) client_negotiation.cc:240] Negotiation successful
0924 12:53:08.623609 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":890,"thread_start_us":665,"threads_started":1}
I20260924 12:53:08.629559 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.600783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60072 (local address 127.11.49.124:36189)
0924 12:53:08.600972 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:08.601007 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:08.608937 (+ 7930us) server_negotiation.cc:407] Connection header received
0924 12:53:08.609661 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:08.609670 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:08.609768 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:08.609880 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:08.612078 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.613375 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.615757 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.616663 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.616776 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.620445 (+ 3669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:08.620453 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:08.620458 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:08.620497 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:08.624466 (+ 3969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.626640 (+ 2174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.626645 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.626649 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.626811 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.627216 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.627220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.627224 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.627702 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:08.627911 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:08.628679 (+ 768us) server_negotiation.cc:299] Negotiation successful
0924 12:53:08.629054 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260924 12:53:08.638036 18264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.603168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50908 (local address 127.11.49.125:45967)
0924 12:53:08.603442 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:08.603452 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:08.611787 (+ 8335us) server_negotiation.cc:407] Connection header received
0924 12:53:08.612102 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:08.612109 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:08.612235 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:08.612354 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:08.614510 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.615640 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.617906 (+ 2266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.618649 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.618794 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.630295 (+ 11501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:08.630304 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:08.630310 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:08.630361 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:08.633812 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.634872 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.634879 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.634882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.635090 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.635654 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.635662 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.635665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.636155 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:08.636367 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:08.637180 (+ 813us) server_negotiation.cc:299] Negotiation successful
0924 12:53:08.637509 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260924 12:53:08.639181 18335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:53:08.639590 18335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } }
I20260924 12:53:08.641953 18353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.601377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:36189 (local address 127.0.0.1:60072)
0924 12:53:08.608732 (+ 7355us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:08.608767 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:08.609444 (+ 677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:08.610153 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:08.610161 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:08.611385 (+ 1224us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:08.611913 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.611926 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.613603 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.613608 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.615577 (+ 1969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.615594 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.617145 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.617151 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.617396 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.618205 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:08.618236 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:08.620095 (+ 1859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:08.624651 (+ 4556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.624658 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.624664 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.625315 (+ 651us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.626944 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.626949 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.626953 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.627089 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.628041 (+ 952us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:08.628048 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:08.628324 (+ 276us) client_negotiation.cc:769] Sending connection context
0924 12:53:08.629909 (+ 1585us) client_negotiation.cc:240] Negotiation successful
0924 12:53:08.632136 (+ 2227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7119,"thread_start_us":7573,"threads_started":1}
I20260924 12:53:08.642400 18335 leader_election.cc:288] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841), 502cf6b751b547f7b1cf2886aea65145 (127.11.49.125:45967)
I20260924 12:53:08.644469 18354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.602417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:45967 (local address 127.0.0.1:50908)
0924 12:53:08.611620 (+ 9203us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:08.611644 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:08.611928 (+ 284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:08.612612 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:08.612621 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:08.613812 (+ 1191us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:08.614302 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.614315 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.615858 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.615863 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.617703 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.617719 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.619581 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.619591 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.619785 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.624807 (+ 5022us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:08.624843 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:08.626430 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:08.634009 (+ 7579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.634017 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.634023 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.634664 (+ 641us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.635267 (+ 603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.635272 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.635276 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.635484 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.636462 (+ 978us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:08.636466 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:08.636843 (+ 377us) client_negotiation.cc:769] Sending connection context
0924 12:53:08.638679 (+ 1836us) client_negotiation.cc:240] Negotiation successful
0924 12:53:08.643815 (+ 5136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8994,"thread_start_us":8489,"threads_started":1}
I20260924 12:53:08.644564 17619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d41c37c4e4042948d4b1c813e179d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7948b76170d6434aad3f4d489ee0b03d" is_pre_election: true
I20260924 12:53:08.645460 18220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d41c37c4e4042948d4b1c813e179d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "502cf6b751b547f7b1cf2886aea65145" is_pre_election: true
I20260924 12:53:08.646873 18279 leader_election.cc:302] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d41c37c4e4042948d4b1c813e179d9c; no voters: 502cf6b751b547f7b1cf2886aea65145, 7948b76170d6434aad3f4d489ee0b03d
I20260924 12:53:08.648030 18335 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
Sep 24 12:53:08 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.49.65@KRBTEST.COM
Sep 24 12:53:08 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254384, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.126@KRBTEST.COM for oryx/127.11.49.124@KRBTEST.COM
I20260924 12:53:08.658751 18263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.634311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:36189 (local address 127.0.0.1:60074)
0924 12:53:08.634766 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:08.634788 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:08.634905 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:08.635723 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:08.635729 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:08.636221 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:08.636472 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.636483 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.638234 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.638240 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.639633 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.639649 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.640811 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.640817 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.640997 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.647209 (+ 6212us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:08.647249 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:08.650381 (+ 3132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:08.655173 (+ 4792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.655179 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.655183 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.655836 (+ 653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.656353 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.656358 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.656361 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.656545 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.657545 (+ 1000us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:08.657560 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:08.657792 (+ 232us) client_negotiation.cc:769] Sending connection context
0924 12:53:08.657974 (+ 182us) client_negotiation.cc:240] Negotiation successful
0924 12:53:08.658316 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313}
I20260924 12:53:08.659410 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.622923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33490 (local address 127.11.49.65:38009)
0924 12:53:08.633887 (+ 10964us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:08.633934 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:08.633977 (+ 43us) server_negotiation.cc:407] Connection header received
0924 12:53:08.634074 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:08.634088 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:08.634489 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:08.636955 (+ 2466us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:08.637309 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.638938 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.641046 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.642169 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.643097 (+ 928us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.651015 (+ 7918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:08.651036 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:08.651055 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:08.651111 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:08.654803 (+ 3692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.656091 (+ 1288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.656101 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.656104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.656368 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.657028 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.657034 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.657038 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.657567 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:08.657949 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:08.658378 (+ 429us) server_negotiation.cc:299] Negotiation successful
0924 12:53:08.658730 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10739,"thread_start_us":10503,"threads_started":1}
I20260924 12:53:08.660040 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.635109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60074 (local address 127.11.49.124:36189)
0924 12:53:08.635269 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:08.635274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:08.635291 (+ 17us) server_negotiation.cc:407] Connection header received
0924 12:53:08.635412 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:08.635418 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:08.635528 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:08.636637 (+ 1109us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:08.636853 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.638074 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.639861 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.640623 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.641356 (+ 733us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.650651 (+ 9295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:08.650662 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:08.650669 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:08.650725 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:08.654978 (+ 4253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.655993 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.655999 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.656003 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.656165 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.656815 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.656821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.656824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.657332 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:08.657519 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:08.659371 (+ 1852us) server_negotiation.cc:299] Negotiation successful
0924 12:53:08.659722 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260924 12:53:08.661442 17793 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:08.662024 17609 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.49.124:36189: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c"
member_type: NON_VOTER
last_known_addr {
host: "127.11.49.124"
port: 36189
}
attrs {
promote: true
}
}
dest_uuid: "7948b76170d6434aad3f4d489ee0b03d"
cas_config_opid_index: 5
I20260924 12:53:08.663729 17609 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } }
I20260924 12:53:08.667317 18171 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 8d41c37c4e4042948d4b1c813e179d9c (127.11.49.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:08.679040 18303 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:08.684604 18303 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 FOLLOWER]: Refusing update from remote peer 7948b76170d6434aad3f4d489ee0b03d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260924 12:53:08.685488 18220 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 LEARNER]: Refusing update from remote peer 7948b76170d6434aad3f4d489ee0b03d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260924 12:53:08.686873 18171 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.49.124:36189
I20260924 12:53:08.687094 18360 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:08.687718 18174 master.cc:537] Master@127.11.49.124:36189 shutting down...
I20260924 12:53:08.688868 18359 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [LEADER]: Connected to new peer: Peer: permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260924 12:53:08.692737 18357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:08.693137 18357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: This master's current role is: LEADER
W20260924 12:53:08.716542 17596 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d -> Peer 8d41c37c4e4042948d4b1c813e179d9c (127.11.49.124:36189): Couldn't send request to peer 8d41c37c4e4042948d4b1c813e179d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260924 12:53:08.717238 18220 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 8d41c37c4e4042948d4b1c813e179d9c (127.11.49.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:08.722817 18248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: NON_VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: true } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:08.723304 18248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: This master's current role is: LEARNER
I20260924 12:53:08.723942 18360 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d: attempting to promote NON_VOTER 502cf6b751b547f7b1cf2886aea65145 to VOTER
I20260924 12:53:08.725318 18360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } }
W20260924 12:53:08.728789 18282 tablet.cc:2369] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:53:08.728899 18220 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 LEARNER]: Refusing update from remote peer 7948b76170d6434aad3f4d489ee0b03d: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260924 12:53:08.730024 18360 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [LEADER]: Connected to new peer: Peer: permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260924 12:53:08.731199 17596 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d -> Peer 8d41c37c4e4042948d4b1c813e179d9c (127.11.49.124:36189): Couldn't send request to peer 8d41c37c4e4042948d4b1c813e179d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260924 12:53:08.731477 18174 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:08.731946 18174 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:08.732160 18174 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: stopping tablet replica
I20260924 12:53:08.733560 18360 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 502cf6b751b547f7b1cf2886aea65145 (127.11.49.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:08.738888 18358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:08.739413 18358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:08.739344 18220 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 502cf6b751b547f7b1cf2886aea65145 (127.11.49.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:08.741446 18174 master.cc:552] Master@127.11.49.124:36189 shutdown complete.
I20260924 12:53:08.741566 18174 master_runner.cc:305] Clearing existing system tablet
I20260924 12:53:08.742036 18174 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:08.742170 18174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:08.745002 18248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:08.745499 18248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:53:08.747939 18174 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.004s
I20260924 12:53:08.749147 18358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:08.749405 18358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:08.750125 18366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:08.750554 18174 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:08.750840 18174 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260924 12:53:08.750942 18174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/wal
uuid: "8d41c37c4e4042948d4b1c813e179d9c"
format_stamp: "Formatted at 2026-09-24 12:53:08 on dist-test-slave-m9hg"
server_key: "a8e767417f8787a22133da7586dca625"
server_key_iv: "266ede8db9839030ed1b72b63a4de99d"
server_key_version: "encryptionkey@0"
I20260924 12:53:08.754544 18174 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:08.759663 18174 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260924 12:53:08.759857 18174 log.cc:1196] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260924 12:53:08.760352 18174 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Deleting consensus metadata
I20260924 12:53:08.760655 18174 master_runner.cc:315] Copying system tablet from 127.11.49.126:40841
I20260924 12:53:08.763558 18174 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.49.126:40841
I20260924 12:53:08.776746 18332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.764820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57918 (local address 127.11.49.126:40841)
0924 12:53:08.765067 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:08.765075 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:08.765126 (+ 51us) server_negotiation.cc:407] Connection header received
0924 12:53:08.765396 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:08.765406 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:08.765496 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:08.765596 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:08.766420 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.767195 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.768582 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.769055 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.769196 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.771129 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:08.771135 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:08.771138 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:08.771170 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:08.773890 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.774565 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.774572 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.774576 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.774721 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:08.775126 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:08.775132 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:08.775136 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:08.775412 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:08.775594 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:08.775990 (+ 396us) server_negotiation.cc:299] Negotiation successful
0924 12:53:08.776209 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
I20260924 12:53:08.777096 18372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:08.764493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:57918)
0924 12:53:08.765027 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:08.765052 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:08.765208 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:08.765627 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:08.765632 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:08.766064 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:08.766270 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.766279 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.767380 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.767386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.768441 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:08.768453 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:08.769220 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:08.769226 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:08.769450 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:08.770153 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:08.770171 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:08.770900 (+ 729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:08.774053 (+ 3153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.774059 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.774063 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.774437 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.774836 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:08.774842 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:08.774846 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:08.774990 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:08.775534 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:08.775553 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:08.775726 (+ 173us) client_negotiation.cc:769] Sending connection context
0924 12:53:08.775878 (+ 152us) client_negotiation.cc:240] Negotiation successful
0924 12:53:08.776243 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":670,"threads_started":1}
I20260924 12:53:08.777860 17629 tablet_copy_service.cc:140] P 7948b76170d6434aad3f4d489ee0b03d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 8d41c37c4e4042948d4b1c813e179d9c ({username='oryx', principal='oryx/127.11.49.124@KRBTEST.COM'} at 127.0.0.1:57918)
I20260924 12:53:08.778031 17629 tablet_copy_service.cc:161] P 7948b76170d6434aad3f4d489ee0b03d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 8d41c37c4e4042948d4b1c813e179d9c at {username='oryx', principal='oryx/127.11.49.124@KRBTEST.COM'} at 127.0.0.1:57918: session id = 8d41c37c4e4042948d4b1c813e179d9c-00000000000000000000000000000000
I20260924 12:53:08.780908 17629 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d: Tablet Copy: opened 0 blocks and 1 log segments
I20260924 12:53:08.782748 18174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260924 12:53:08.787775 18174 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: tablet copy: Starting download of 0 data blocks...
I20260924 12:53:08.788087 18174 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: tablet copy: Starting download of 1 WAL segments...
I20260924 12:53:08.790372 18174 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260924 12:53:08.793708 17629 tablet_copy_service.cc:342] P 7948b76170d6434aad3f4d489ee0b03d: Request end of tablet copy session 8d41c37c4e4042948d4b1c813e179d9c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.49.124@KRBTEST.COM'} at 127.0.0.1:57918
I20260924 12:53:08.793853 17629 tablet_copy_service.cc:433] P 7948b76170d6434aad3f4d489ee0b03d: ending tablet copy session 8d41c37c4e4042948d4b1c813e179d9c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 8d41c37c4e4042948d4b1c813e179d9c
I20260924 12:53:08.806591 18174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:08.810007 18373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:08.810809 18374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:08.818975 18376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:08.819288 18174 server_base.cc:1034] running on GCE node
I20260924 12:53:08.819749 18174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:08.820591 18174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:08.821084 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 17670
I20260924 12:53:08.821975 18174 hybrid_clock.cc:648] HybridClock initialized: now 1790254388821907 us; error 83 us; skew 500 ppm
I20260924 12:53:08.822238 18174 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:08 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254388, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:08.824803 18174 init.cc:377] Logged in from keytab as oryx/127.11.49.124@KRBTEST.COM (short username oryx)
I20260924 12:53:08.830883 18174 webserver.cc:460] Webserver started at http://127.11.49.124:35151/ using document root <none> and password file <none>
I20260924 12:53:08.831290 18174 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:08.831409 18174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:08.835003 18174 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260924 12:53:08.838150 18383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:08.838868 18174 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260924 12:53:08.839110 18174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/wal
uuid: "8d41c37c4e4042948d4b1c813e179d9c"
format_stamp: "Formatted at 2026-09-24 12:53:08 on dist-test-slave-m9hg"
server_key: "a8e767417f8787a22133da7586dca625"
server_key_iv: "266ede8db9839030ed1b72b63a4de99d"
server_key_version: "encryptionkey@0"
I20260924 12:53:08.839381 18174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:08.846009 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:38009
--local_ip_for_outbound_sockets=127.11.49.65
--tserver_master_addrs=127.11.49.126:40841
--webserver_port=40365
--webserver_interface=127.11.49.65
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab
--principal=oryx/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.49.126:40841,127.11.49.125:45967
--tserver_master_addrs=127.11.49.126:40841,127.11.49.125:45967,127.11.49.124:36189 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:53:08.895977 18174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:08.900707 18174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:08.945443 18435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.124:36189 every 8 connection(s)
I20260924 12:53:08.945446 18174 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.124:36189
I20260924 12:53:08.947044 18174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
I20260924 12:53:08.953338 18436 sys_catalog.cc:263] Verifying existing consensus state
I20260924 12:53:08.958140 18436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Bootstrap starting.
I20260924 12:53:08.983125 18436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 12:53:08.984050 18436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Bootstrap complete.
I20260924 12:53:08.985385 18436 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } }
I20260924 12:53:08.985797 18436 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d41c37c4e4042948d4b1c813e179d9c, State: Initialized, Role: LEARNER
I20260924 12:53:08.986116 18436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } }
I20260924 12:53:08.987732 18436 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:53:08.987377 18439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:08.988169 18439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: This master's current role is: LEARNER
I20260924 12:53:09.006155 18450 catalog_manager.cc:1259] Loaded cluster ID: fbf514c5d25b49c68fa830f42d936032
I20260924 12:53:09.006282 18450 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: loading cluster ID for follower catalog manager: success
I20260924 12:53:09.011173 18450 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: acquiring CA information for follower catalog manager: success
I20260924 12:53:09.015693 18450 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 12:53:09.158178 18451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:09.133129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60082 (local address 127.11.49.124:36189)
0924 12:53:09.149085 (+ 15956us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:09.149097 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:09.149149 (+ 52us) server_negotiation.cc:407] Connection header received
0924 12:53:09.149283 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:09.149291 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:09.149439 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:09.149672 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:09.150366 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.152145 (+ 1779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.154927 (+ 2782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.156673 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.156926 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:09.157266 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:09.157553 (+ 287us) server_negotiation.cc:299] Negotiation successful
0924 12:53:09.157725 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15688,"thread_start_us":15914,"threads_started":1}
I20260924 12:53:09.158229 18263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:09.131741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:36189 (local address 127.0.0.1:60082)
0924 12:53:09.132345 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:09.132376 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:09.132595 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:09.149803 (+ 17208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:09.149810 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:09.149871 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:09.150095 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:09.150107 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.152448 (+ 2341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.152455 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:09.154619 (+ 2164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:09.154640 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.157067 (+ 2427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.157075 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:09.157295 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:09.157334 (+ 39us) client_negotiation.cc:769] Sending connection context
0924 12:53:09.157486 (+ 152us) client_negotiation.cc:240] Negotiation successful
0924 12:53:09.157659 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381}
I20260924 12:53:09.160678 18411 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260924 12:53:09.161522 18439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7948b76170d6434aad3f4d489ee0b03d. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:09.161959 18439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: This master's current role is: LEARNER
W20260924 12:53:09.346747 18388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:09.347234 18388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:09.347424 18388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:09.356206 18388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:09.356489 18388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:09.356711 18388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:53:09.369726 18388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab
--principal=oryx/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:38009
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=40365
--tserver_master_addrs=127.11.49.126:40841,127.11.49.125:45967,127.11.49.124:36189
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:09.371899 18388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:09.373948 18388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:09.393283 18457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:09.393332 18456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:09.393496 18459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:09.394438 18388 server_base.cc:1034] running on GCE node
I20260924 12:53:09.395222 18388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:09.396561 18388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:09.399986 18388 hybrid_clock.cc:648] HybridClock initialized: now 1790254389399893 us; error 86 us; skew 500 ppm
I20260924 12:53:09.400544 18388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:09 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254389, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:09.404546 18388 init.cc:377] Logged in from keytab as oryx/127.11.49.65@KRBTEST.COM (short username oryx)
I20260924 12:53:09.406495 18388 webserver.cc:460] Webserver started at http://127.11.49.65:40365/ using document root <none> and password file <none>
I20260924 12:53:09.407425 18388 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:09.407619 18388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:09.414503 18388 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260924 12:53:09.418541 18466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:09.420430 18388 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260924 12:53:09.420681 18388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "12dfc0d55448464ab20e07e9de4d07ac"
format_stamp: "Formatted at 2026-09-24 12:53:05 on dist-test-slave-m9hg"
server_key: "4240bb61f6f57e97bb794bda547c54f2"
server_key_iv: "64de62573cc21190cb0a57b44c3e4605"
server_key_version: "encryptionkey@0"
I20260924 12:53:09.421772 18388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:09.435005 18388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:09.440153 18388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:09.440517 18388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:09.441699 18388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:09.443223 18388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:09.443367 18388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:09.443516 18388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:09.443614 18388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:09.483107 18388 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:38009
I20260924 12:53:09.483209 18578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:38009 every 8 connection(s)
I20260924 12:53:09.484817 18388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:53:09.489946 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 18388
I20260924 12:53:09.490432 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 17804
Sep 24 12:53:09 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254389, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
Sep 24 12:53:09 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254389, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.124@KRBTEST.COM
Sep 24 12:53:09 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.49.66@KRBTEST.COM
Sep 24 12:53:09 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254389, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.125@KRBTEST.COM
I20260924 12:53:09.522920 18583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:09.488554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:34939 (local address 127.11.49.126:40841)
0924 12:53:09.489265 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:09.489272 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:09.499346 (+ 10074us) server_negotiation.cc:407] Connection header received
0924 12:53:09.499415 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:09.499427 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:09.499493 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:09.499629 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:09.501105 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.502226 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.504534 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.505159 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.505305 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:09.511475 (+ 6170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:09.511482 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:09.511488 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:09.511537 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:09.516472 (+ 4935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:09.519084 (+ 2612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:09.519095 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:09.519099 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:09.519345 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:09.520188 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:09.520197 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:09.520201 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:09.520733 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:09.520926 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:09.522076 (+ 1150us) server_negotiation.cc:299] Negotiation successful
0924 12:53:09.522428 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":438,"threads_started":1}
I20260924 12:53:09.523689 18451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:09.488909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:54681 (local address 127.11.49.124:36189)
0924 12:53:09.489139 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:09.489147 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:09.490779 (+ 1632us) server_negotiation.cc:407] Connection header received
0924 12:53:09.494561 (+ 3782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:09.494572 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:09.494711 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:09.494806 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:09.498070 (+ 3264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.499244 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.505146 (+ 5902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.506248 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.506471 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:09.513675 (+ 7204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:09.513683 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:09.513687 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:09.513743 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:09.517336 (+ 3593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:09.519617 (+ 2281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:09.519624 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:09.519628 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:09.519980 (+ 352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:09.520799 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:09.520807 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:09.520814 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:09.521199 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:09.521335 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:09.522824 (+ 1489us) server_negotiation.cc:299] Negotiation successful
0924 12:53:09.523136 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260924 12:53:09.525198 18584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:09.489595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:36189 (local address 127.11.49.65:54681)
0924 12:53:09.490573 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:09.490631 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:09.494088 (+ 3457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:09.495514 (+ 1426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:09.495531 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:09.496637 (+ 1106us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:09.497766 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:09.497800 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.499904 (+ 2104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.499911 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:09.504871 (+ 4960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:09.504883 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.506528 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.506537 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:09.506765 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:09.508537 (+ 1772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:09.508572 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:09.513331 (+ 4759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:09.517568 (+ 4237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:09.517578 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:09.517608 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:09.518888 (+ 1280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:09.520413 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:09.520419 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:09.520423 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:09.520626 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:09.522213 (+ 1587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:09.522218 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:09.522477 (+ 259us) client_negotiation.cc:769] Sending connection context
0924 12:53:09.523955 (+ 1478us) client_negotiation.cc:240] Negotiation successful
0924 12:53:09.524400 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"mutex_wait_us":472,"spinlock_wait_cycles":34560,"thread_start_us":18134,"threads_started":1}
I20260924 12:53:09.525848 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:09.489689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.65:34939)
0924 12:53:09.498884 (+ 9195us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:09.498905 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:09.499025 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:09.499651 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:09.499655 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:09.500452 (+ 797us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:09.500946 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:09.500960 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.502585 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.502593 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:09.504387 (+ 1794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:09.504402 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.505423 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.505432 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:09.505745 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:09.507235 (+ 1490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:09.507279 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:09.511065 (+ 3786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:09.517567 (+ 6502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:09.517592 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:09.517612 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:09.518904 (+ 1292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:09.519576 (+ 672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:09.519581 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:09.519587 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:09.519868 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:09.521048 (+ 1180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:09.521055 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:09.521447 (+ 392us) client_negotiation.cc:769] Sending connection context
0924 12:53:09.521753 (+ 306us) client_negotiation.cc:240] Negotiation successful
0924 12:53:09.522289 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9046,"mutex_wait_us":62,"spinlock_wait_cycles":18688,"thread_start_us":389,"threads_started":1}
I20260924 12:53:09.527886 18579 heartbeater.cc:347] Connected to a master server at 127.11.49.124:36189
I20260924 12:53:09.527940 18580 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40841
I20260924 12:53:09.528378 18580 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:09.528383 18579 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:09.529908 18579 heartbeater.cc:511] Master 127.11.49.124:36189 requested a full tablet report, sending...
I20260924 12:53:09.531206 18585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:09.491332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:45967 (local address 127.11.49.65:49633)
0924 12:53:09.508302 (+ 16970us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:09.508324 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:09.508519 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:09.509188 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:09.509191 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:09.509565 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:09.509809 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:09.509854 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.512757 (+ 2903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.512762 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:09.514139 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:09.514156 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.515452 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.515462 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:09.515663 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:09.518107 (+ 2444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:09.518132 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:09.522319 (+ 4187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:09.527692 (+ 5373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:09.527698 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:09.527702 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:09.528505 (+ 803us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:09.528992 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:09.528998 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:09.529002 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:09.529217 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:09.529957 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:09.529965 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:09.530197 (+ 232us) client_negotiation.cc:769] Sending connection context
0924 12:53:09.530369 (+ 172us) client_negotiation.cc:240] Negotiation successful
0924 12:53:09.530707 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16761,"thread_start_us":7772,"threads_started":1}
I20260924 12:53:09.531574 18580 heartbeater.cc:511] Master 127.11.49.126:40841 requested a full tablet report, sending...
I20260924 12:53:09.531255 18588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:09.492365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:49633 (local address 127.11.49.125:45967)
0924 12:53:09.505551 (+ 13186us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:09.505560 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:09.508406 (+ 2846us) server_negotiation.cc:407] Connection header received
0924 12:53:09.508678 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:09.508685 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:09.508796 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:09.508887 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:09.510023 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.512568 (+ 2545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.514372 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.515014 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.515130 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:09.522573 (+ 7443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:09.522591 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:09.522598 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:09.522646 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:09.527485 (+ 4839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:09.528641 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:09.528649 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:09.528655 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:09.528832 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:09.529351 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:09.529356 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:09.529358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:09.529784 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:09.529939 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:09.530569 (+ 630us) server_negotiation.cc:299] Negotiation successful
0924 12:53:09.530848 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12002,"thread_start_us":11874,"threads_started":1}
I20260924 12:53:09.532927 18581 heartbeater.cc:347] Connected to a master server at 127.11.49.125:45967
I20260924 12:53:09.532999 17609 ts_manager.cc:194] Re-registered known tserver with Master: 12dfc0d55448464ab20e07e9de4d07ac (127.11.49.65:38009)
I20260924 12:53:09.533088 18581 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:09.533222 18401 ts_manager.cc:194] Registered new tserver with Master: 12dfc0d55448464ab20e07e9de4d07ac (127.11.49.65:38009)
I20260924 12:53:09.533543 18581 heartbeater.cc:511] Master 127.11.49.125:45967 requested a full tablet report, sending...
I20260924 12:53:09.534112 17609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:34939
I20260924 12:53:09.535195 18589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:09.492956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36360 (local address 127.11.49.66:33793)
0924 12:53:09.503379 (+ 10423us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:09.503389 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:09.503420 (+ 31us) server_negotiation.cc:407] Connection header received
0924 12:53:09.503488 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:09.503497 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:09.503766 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:09.503923 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:09.507887 (+ 3964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.509856 (+ 1969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.513542 (+ 3686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:09.514779 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:09.515760 (+ 981us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:09.523808 (+ 8048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:09.523834 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:09.523856 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:09.523919 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:09.528669 (+ 4750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:09.529741 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:09.529751 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:09.529754 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:09.529930 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:09.530351 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:09.530357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:09.530360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:09.530789 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:09.531055 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:09.534450 (+ 3395us) server_negotiation.cc:299] Negotiation successful
0924 12:53:09.534802 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7996,"thread_start_us":7831,"threads_started":1}
I20260924 12:53:09.536383 18210 ts_manager.cc:194] Registered new tserver with Master: 12dfc0d55448464ab20e07e9de4d07ac (127.11.49.65:38009)
I20260924 12:53:09.536669 17927 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:09.639674 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 17804
I20260924 12:53:09.660550 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:33793
--local_ip_for_outbound_sockets=127.11.49.66
--tserver_master_addrs=127.11.49.126:40841
--webserver_port=36455
--webserver_interface=127.11.49.66
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab
--principal=oryx/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.49.126:40841,127.11.49.125:45967
--tserver_master_addrs=127.11.49.126:40841,127.11.49.125:45967,127.11.49.124:36189 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:53:09.673468 18360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: NON_VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: true } } }
I20260924 12:53:09.673990 18360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:09.675323 18360 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d: attempting to promote NON_VOTER 8d41c37c4e4042948d4b1c813e179d9c to VOTER
I20260924 12:53:09.676082 18360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } }
I20260924 12:53:09.678468 18220 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Refusing update from remote peer 7948b76170d6434aad3f4d489ee0b03d: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260924 12:53:09.678632 18411 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 LEARNER]: Refusing update from remote peer 7948b76170d6434aad3f4d489ee0b03d: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260924 12:53:09.679289 18360 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [LEADER]: Connected to new peer: Peer: permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260924 12:53:09.679765 18593 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260924 12:53:09.684134 18220 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8d41c37c4e4042948d4b1c813e179d9c (127.11.49.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:09.683485 18592 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8d41c37c4e4042948d4b1c813e179d9c (127.11.49.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:09.687479 18411 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8d41c37c4e4042948d4b1c813e179d9c (127.11.49.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:09.690862 18592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:09.691169 18592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:09.691526 18360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:09.691869 18360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:09.692147 18360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:09.692412 18360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:09.695868 18597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:09.696452 18597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:53:09.696971 18596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7948b76170d6434aad3f4d489ee0b03d" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:09.697423 18596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: This master's current role is: FOLLOWER
W20260924 12:53:10.125284 18591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:10.125957 18591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:10.126184 18591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:10.135715 18591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:10.135972 18591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:10.136197 18591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:53:10.149381 18591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab
--principal=oryx/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:33793
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=36455
--tserver_master_addrs=127.11.49.126:40841,127.11.49.125:45967,127.11.49.124:36189
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:10.151410 18591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:10.153359 18591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:10.172344 18602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:10.172312 18605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:10.172403 18603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:10.173933 18591 server_base.cc:1034] running on GCE node
I20260924 12:53:10.174850 18591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:10.176164 18591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:10.177449 18591 hybrid_clock.cc:648] HybridClock initialized: now 1790254390177356 us; error 58 us; skew 500 ppm
I20260924 12:53:10.177923 18591 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:10 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254390, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:10.182363 18591 init.cc:377] Logged in from keytab as oryx/127.11.49.66@KRBTEST.COM (short username oryx)
I20260924 12:53:10.184163 18591 webserver.cc:460] Webserver started at http://127.11.49.66:36455/ using document root <none> and password file <none>
I20260924 12:53:10.184990 18591 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:10.185115 18591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:10.191620 18591 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260924 12:53:10.195428 18612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:10.197587 18591 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:53:10.197798 18591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "218e5d98186f4b40a3e8f31efba815f8"
format_stamp: "Formatted at 2026-09-24 12:53:06 on dist-test-slave-m9hg"
server_key: "bfb47a443e48646d5676cb0598ce37ab"
server_key_iv: "bb0aebec232aa5e3f61930712f9b9ba9"
server_key_version: "encryptionkey@0"
I20260924 12:53:10.199074 18591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:10.235675 18591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:10.241043 18591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:10.241350 18591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:10.242417 18591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:10.243894 18591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:10.244006 18591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:10.244086 18591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:10.244148 18591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:10.284518 18591 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:33793
I20260924 12:53:10.284688 18724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:33793 every 8 connection(s)
I20260924 12:53:10.286073 18591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:53:10.295203 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 18591
I20260924 12:53:10.295689 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 17938
Sep 24 12:53:10 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.49.67@KRBTEST.COM
Sep 24 12:53:10 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254390, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.125@KRBTEST.COM
Sep 24 12:53:10 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254390, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.124@KRBTEST.COM
I20260924 12:53:10.344645 18734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:10.297722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43496 (local address 127.11.49.67:43695)
0924 12:53:10.309175 (+ 11453us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:10.309192 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:10.310433 (+ 1241us) server_negotiation.cc:407] Connection header received
0924 12:53:10.310539 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:10.310549 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:10.310939 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:10.311121 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:10.314772 (+ 3651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.317454 (+ 2682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.320773 (+ 3319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.322371 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.322591 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:10.333019 (+ 10428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:10.333048 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:10.333073 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:10.333137 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:10.339081 (+ 5944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:10.340438 (+ 1357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:10.340453 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:10.340458 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:10.340772 (+ 314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:10.341321 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:10.341326 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:10.341329 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:10.341903 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:10.342261 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:10.343651 (+ 1390us) server_negotiation.cc:299] Negotiation successful
0924 12:53:10.344050 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11141,"thread_start_us":10885,"threads_started":1}
I20260924 12:53:10.346665 18729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:10.289956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:55399 (local address 127.11.49.124:36189)
0924 12:53:10.306265 (+ 16309us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:10.306279 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:10.316403 (+ 10124us) server_negotiation.cc:407] Connection header received
0924 12:53:10.328345 (+ 11942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:10.328352 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:10.328446 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:10.328527 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:10.329651 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.330764 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.333336 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.333969 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.334087 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:10.338928 (+ 4841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:10.338936 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:10.338941 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:10.338979 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:10.342734 (+ 3755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:10.343548 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:10.343553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:10.343556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:10.343700 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:10.344251 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:10.344255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:10.344259 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:10.344655 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:10.344816 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:10.345941 (+ 1125us) server_negotiation.cc:299] Negotiation successful
0924 12:53:10.346208 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16013,"thread_start_us":16343,"threads_started":1}
I20260924 12:53:10.346843 18061 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:10.347657 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:10.290789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:36189 (local address 127.11.49.66:55399)
0924 12:53:10.310817 (+ 20028us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:10.310906 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:10.321522 (+ 10616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:10.328797 (+ 7275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:10.328805 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:10.329200 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:10.329500 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:10.329509 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.330946 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.330952 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:10.333153 (+ 2201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:10.333174 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.334138 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.334144 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:10.334359 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:10.335628 (+ 1269us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:10.335674 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:10.338686 (+ 3012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:10.342895 (+ 4209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:10.342900 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:10.342904 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:10.343406 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:10.343827 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:10.343832 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:10.343836 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:10.344108 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:10.344900 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:10.344909 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:10.345385 (+ 476us) client_negotiation.cc:769] Sending connection context
0924 12:53:10.345701 (+ 316us) client_negotiation.cc:240] Negotiation successful
0924 12:53:10.346231 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19504,"spinlock_wait_cycles":5504,"thread_start_us":32483,"threads_started":1}
I20260924 12:53:10.347811 18730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:10.290051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:41907 (local address 127.11.49.125:45967)
0924 12:53:10.306906 (+ 16855us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:10.306911 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:10.323919 (+ 17008us) server_negotiation.cc:407] Connection header received
0924 12:53:10.324088 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:10.324094 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:10.324188 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:10.324364 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:10.327574 (+ 3210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.328757 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.332193 (+ 3436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.332885 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.333013 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:10.338322 (+ 5309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:10.338328 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:10.338331 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:10.338364 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:10.342194 (+ 3830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:10.343568 (+ 1374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:10.343574 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:10.343578 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:10.343751 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:10.344422 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:10.344430 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:10.344434 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:10.344858 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:10.344999 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:10.347092 (+ 2093us) server_negotiation.cc:299] Negotiation successful
0924 12:53:10.347395 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16719,"thread_start_us":16598,"threads_started":1}
Sep 24 12:53:10 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254390, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:10.349778 18725 heartbeater.cc:347] Connected to a master server at 127.11.49.124:36189
I20260924 12:53:10.350131 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:10.290794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:45967 (local address 127.11.49.66:41907)
0924 12:53:10.323761 (+ 32967us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:10.323782 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:10.323972 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:10.325524 (+ 1552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:10.325534 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:10.326576 (+ 1042us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:10.327364 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:10.327384 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.329759 (+ 2375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.329766 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:10.332034 (+ 2268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:10.332048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.333165 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.333175 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:10.333504 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:10.334624 (+ 1120us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:10.334656 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:10.338094 (+ 3438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:10.342375 (+ 4281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:10.342385 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:10.342407 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:10.343122 (+ 715us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:10.344079 (+ 957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:10.344085 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:10.344090 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:10.344240 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:10.346257 (+ 2017us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:10.346261 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:10.346393 (+ 132us) client_negotiation.cc:769] Sending connection context
0924 12:53:10.346545 (+ 152us) client_negotiation.cc:240] Negotiation successful
0924 12:53:10.346817 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32774,"mutex_wait_us":64,"spinlock_wait_cycles":88320,"thread_start_us":19145,"threads_started":1}
I20260924 12:53:10.350399 18725 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:10.351835 18725 heartbeater.cc:511] Master 127.11.49.124:36189 requested a full tablet report, sending...
I20260924 12:53:10.353361 18727 heartbeater.cc:347] Connected to a master server at 127.11.49.125:45967
I20260924 12:53:10.353570 18727 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:10.354154 18727 heartbeater.cc:511] Master 127.11.49.125:45967 requested a full tablet report, sending...
I20260924 12:53:10.355577 18401 ts_manager.cc:194] Registered new tserver with Master: 218e5d98186f4b40a3e8f31efba815f8 (127.11.49.66:33793)
I20260924 12:53:10.357167 18210 ts_manager.cc:194] Registered new tserver with Master: 218e5d98186f4b40a3e8f31efba815f8 (127.11.49.66:33793)
I20260924 12:53:10.362051 18735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:10.311864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.66:53029)
0924 12:53:10.332672 (+ 20808us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:10.332712 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:10.332915 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:10.334717 (+ 1802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:10.334722 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:10.335354 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:10.335865 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:10.335883 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.340264 (+ 4381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.340292 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:10.342001 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:10.342018 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.343569 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.343576 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:10.343792 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:10.344470 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:10.344491 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:10.349871 (+ 5380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:10.358748 (+ 8877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:10.358753 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:10.358757 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:10.359305 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:10.359855 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:10.359861 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:10.359864 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:10.360043 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:10.360849 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:10.360854 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:10.361062 (+ 208us) client_negotiation.cc:769] Sending connection context
0924 12:53:10.361261 (+ 199us) client_negotiation.cc:240] Negotiation successful
0924 12:53:10.361645 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20659,"thread_start_us":20499,"threads_started":1}
I20260924 12:53:10.362182 18736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:10.311973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:53029 (local address 127.11.49.126:40841)
0924 12:53:10.328114 (+ 16141us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:10.328120 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:10.332800 (+ 4680us) server_negotiation.cc:407] Connection header received
0924 12:53:10.334112 (+ 1312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:10.334120 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:10.334241 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:10.334386 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:10.337277 (+ 2891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.339504 (+ 2227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.342471 (+ 2967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:10.343178 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:10.343349 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:10.352821 (+ 9472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:10.352827 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:10.352830 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:10.352868 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:10.358597 (+ 5729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:10.359496 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:10.359503 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:10.359508 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:10.359676 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:10.360204 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:10.360210 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:10.360214 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:10.360665 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:10.360834 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:10.361449 (+ 615us) server_negotiation.cc:299] Negotiation successful
0924 12:53:10.361723 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15996,"thread_start_us":16130,"threads_started":1}
I20260924 12:53:10.363139 18726 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40841
I20260924 12:53:10.363329 18726 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:10.363895 18726 heartbeater.cc:511] Master 127.11.49.126:40841 requested a full tablet report, sending...
I20260924 12:53:10.365365 17609 ts_manager.cc:194] Re-registered known tserver with Master: 218e5d98186f4b40a3e8f31efba815f8 (127.11.49.66:33793)
I20260924 12:53:10.366688 17609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:53029
I20260924 12:53:10.447255 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 17938
I20260924 12:53:10.466382 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:43695
--local_ip_for_outbound_sockets=127.11.49.67
--tserver_master_addrs=127.11.49.126:40841
--webserver_port=34191
--webserver_interface=127.11.49.67
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab
--principal=oryx/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:39493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.49.126:40841,127.11.49.125:45967
--tserver_master_addrs=127.11.49.126:40841,127.11.49.125:45967,127.11.49.124:36189 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:53:10.538057 18580 heartbeater.cc:503] Master 127.11.49.126:40841 was elected leader, sending a full tablet report...
W20260924 12:53:10.895102 18738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:10.895512 18738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:10.895696 18738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:10.904716 18738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:10.904899 18738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:10.905105 18738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:53:10.916813 18738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab
--principal=oryx/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:43695
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=34191
--tserver_master_addrs=127.11.49.126:40841,127.11.49.125:45967,127.11.49.124:36189
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:10.918687 18738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:10.920430 18738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:10.937367 18744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:10.937566 18746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:10.937392 18743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:10.938424 18738 server_base.cc:1034] running on GCE node
I20260924 12:53:10.939219 18738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:10.940654 18738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:10.941952 18738 hybrid_clock.cc:648] HybridClock initialized: now 1790254390941856 us; error 70 us; skew 500 ppm
I20260924 12:53:10.942453 18738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:10 dist-test-slave-m9hg krb5kdc[17564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254390, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:10.952296 18738 init.cc:377] Logged in from keytab as oryx/127.11.49.67@KRBTEST.COM (short username oryx)
I20260924 12:53:10.954180 18738 webserver.cc:460] Webserver started at http://127.11.49.67:34191/ using document root <none> and password file <none>
I20260924 12:53:10.955011 18738 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:10.955180 18738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:10.961618 18738 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:53:10.965569 18753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:10.967509 18738 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:53:10.967746 18738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "9cdad6dae8934f2cbee30e01112c39df"
format_stamp: "Formatted at 2026-09-24 12:53:06 on dist-test-slave-m9hg"
server_key: "363a8490299789ee90bf5dd051212bb7"
server_key_iv: "31d93d2fba0d92149ff66c88be4da5fa"
server_key_version: "encryptionkey@0"
I20260924 12:53:10.968976 18738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:10.994599 18738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:10.999605 18738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:10.999953 18738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:11.001243 18738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:11.003026 18738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:11.003196 18738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:11.003321 18738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:11.003412 18738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:11.044971 18738 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:43695
I20260924 12:53:11.045145 18865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:43695 every 8 connection(s)
I20260924 12:53:11.046541 18738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:53:11.054541 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 18738
Sep 24 12:53:11 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254390, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.125@KRBTEST.COM
Sep 24 12:53:11 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254390, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.124@KRBTEST.COM
Sep 24 12:53:11 dist-test-slave-m9hg krb5kdc[17564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254390, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:11.097916 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.050467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:37997 (local address 127.11.49.124:36189)
0924 12:53:11.051167 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.051175 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.052598 (+ 1423us) server_negotiation.cc:407] Connection header received
0924 12:53:11.055566 (+ 2968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.055573 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.055689 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.055779 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:11.058884 (+ 3105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.060556 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.065231 (+ 4675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.066649 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.066869 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.075819 (+ 8950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:11.075829 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:11.075833 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:11.075905 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:11.080580 (+ 4675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.088054 (+ 7474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.088064 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.088070 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.088350 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.091248 (+ 2898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.091258 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.091264 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.091788 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:11.091965 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.097190 (+ 5225us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.097478 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":258,"threads_started":1}
I20260924 12:53:11.100324 18873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.051702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:37523 (local address 127.11.49.125:45967)
0924 12:53:11.052669 (+ 967us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.052677 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.059168 (+ 6491us) server_negotiation.cc:407] Connection header received
0924 12:53:11.059263 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.059272 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.059375 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.059493 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:11.061203 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.062799 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.065793 (+ 2994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.066738 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.066905 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.075297 (+ 8392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:11.075308 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:11.075316 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:11.075389 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:11.084490 (+ 9101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.087387 (+ 2897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.087394 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.087398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.087585 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.088714 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.088723 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.088726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.089227 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:11.089417 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.099549 (+ 10132us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.099828 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":807,"thread_start_us":1650,"threads_started":1}
I20260924 12:53:11.100263 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.051175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:45967 (local address 127.11.49.67:37523)
0924 12:53:11.058809 (+ 7634us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:11.058836 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:11.058975 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:11.059729 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:11.059737 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:11.060497 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:11.060955 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.060973 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.063035 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.063044 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.065556 (+ 2512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.065583 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.067373 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.067384 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.067935 (+ 551us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.069170 (+ 1235us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:11.069231 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:11.074877 (+ 5646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:11.086446 (+ 11569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:11.086460 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:11.086484 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:11.087228 (+ 744us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:11.087741 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:11.087745 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:11.087750 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:11.088556 (+ 806us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:11.089554 (+ 998us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:11.089568 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:11.090253 (+ 685us) client_negotiation.cc:769] Sending connection context
0924 12:53:11.099389 (+ 9136us) client_negotiation.cc:240] Negotiation successful
0924 12:53:11.099802 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"mutex_wait_us":84,"thread_start_us":571,"threads_started":1}
I20260924 12:53:11.101950 18868 heartbeater.cc:347] Connected to a master server at 127.11.49.125:45967
I20260924 12:53:11.102304 18868 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:11.099282 18872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.051190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:36189 (local address 127.11.49.67:37997)
0924 12:53:11.052399 (+ 1209us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:11.052452 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:11.055132 (+ 2680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:11.056403 (+ 1271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:11.056419 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:11.057436 (+ 1017us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:11.058544 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.058575 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.060992 (+ 2417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.061003 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.064818 (+ 3815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.064855 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.067704 (+ 2849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.067716 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.068186 (+ 470us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.069411 (+ 1225us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:11.069465 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:11.075431 (+ 5966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:11.087417 (+ 11986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:11.087422 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:11.087425 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:11.087900 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:11.090741 (+ 2841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:11.090750 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:11.090756 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:11.091044 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:11.096584 (+ 5540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:11.096590 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:11.096840 (+ 250us) client_negotiation.cc:769] Sending connection context
0924 12:53:11.097062 (+ 222us) client_negotiation.cc:240] Negotiation successful
0924 12:53:11.097723 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":972,"mutex_wait_us":191,"thread_start_us":504,"threads_started":1}
I20260924 12:53:11.103246 18868 heartbeater.cc:511] Master 127.11.49.125:45967 requested a full tablet report, sending...
I20260924 12:53:11.105304 18866 heartbeater.cc:347] Connected to a master server at 127.11.49.124:36189
I20260924 12:53:11.105558 18866 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:11.106077 18866 heartbeater.cc:511] Master 127.11.49.124:36189 requested a full tablet report, sending...
I20260924 12:53:11.106340 18210 ts_manager.cc:194] Registered new tserver with Master: 9cdad6dae8934f2cbee30e01112c39df (127.11.49.67:43695)
I20260924 12:53:11.109092 18875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.053378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:35039 (local address 127.11.49.126:40841)
0924 12:53:11.069648 (+ 16270us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.069656 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.069686 (+ 30us) server_negotiation.cc:407] Connection header received
0924 12:53:11.069776 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.069782 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.070026 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.070225 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:11.072195 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.073404 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.075801 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.076893 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.077103 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.092197 (+ 15094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:11.092208 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:11.092216 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:11.092330 (+ 114us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:11.098907 (+ 6577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.100660 (+ 1753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.100667 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.100671 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.101380 (+ 709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.106823 (+ 5443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.106831 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.106835 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.107313 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:11.107509 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.108265 (+ 756us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.108626 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16054,"thread_start_us":15788,"threads_started":1}
I20260924 12:53:11.109088 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.053197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.67:35039)
0924 12:53:11.053974 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:11.053999 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:11.055152 (+ 1153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:11.070264 (+ 15112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:11.070270 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:11.071128 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:11.071869 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.071896 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.073628 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.073636 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.075636 (+ 2000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.075652 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.077145 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.077154 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.077412 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.078076 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:11.078105 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:11.091539 (+ 13434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:11.099171 (+ 7632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:11.099180 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:11.099188 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:11.100036 (+ 848us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:11.101543 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:11.101550 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:11.101554 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:11.101804 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:11.107538 (+ 5734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:11.107548 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:11.107859 (+ 311us) client_negotiation.cc:769] Sending connection context
0924 12:53:11.108090 (+ 231us) client_negotiation.cc:240] Negotiation successful
0924 12:53:11.108540 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":357,"threads_started":1}
I20260924 12:53:11.111207 18401 ts_manager.cc:194] Registered new tserver with Master: 9cdad6dae8934f2cbee30e01112c39df (127.11.49.67:43695)
I20260924 12:53:11.112401 18867 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40841
I20260924 12:53:11.112628 18867 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:11.113305 18867 heartbeater.cc:511] Master 127.11.49.126:40841 requested a full tablet report, sending...
I20260924 12:53:11.114627 17609 ts_manager.cc:194] Re-registered known tserver with Master: 9cdad6dae8934f2cbee30e01112c39df (127.11.49.67:43695)
I20260924 12:53:11.115988 17609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:35039
I20260924 12:53:11.122989 18882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.079965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50914 (local address 127.11.49.125:45967)
0924 12:53:11.095330 (+ 15365us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.095340 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.095366 (+ 26us) server_negotiation.cc:407] Connection header received
0924 12:53:11.095446 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.095453 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.095645 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.095778 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:11.100364 (+ 4586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.101819 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.104132 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.105158 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.105301 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.112936 (+ 7635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:11.112944 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:11.112950 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:11.112997 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:11.118983 (+ 5986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.120136 (+ 1153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.120141 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.120144 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.120349 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.120772 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.120777 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.120780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.121058 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:11.121359 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.122322 (+ 963us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.122549 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15058,"thread_start_us":15275,"threads_started":1}
I20260924 12:53:11.128109 18881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.076107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57924 (local address 127.11.49.126:40841)
0924 12:53:11.108390 (+ 32283us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.108397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.108420 (+ 23us) server_negotiation.cc:407] Connection header received
0924 12:53:11.108491 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.108497 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.108590 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.108728 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:11.111042 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.114254 (+ 3212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.115872 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.116763 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.116915 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.120529 (+ 3614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:11.120538 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:11.120547 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:11.120608 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:11.125215 (+ 4607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.126042 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.126048 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.126052 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.126192 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.126598 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.126603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.126606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.126885 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:11.127181 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.127551 (+ 370us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.127764 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32065,"thread_start_us":32791,"threads_started":1}
I20260924 12:53:11.131492 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.084172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60092 (local address 127.11.49.124:36189)
0924 12:53:11.098208 (+ 14036us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.098215 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.109883 (+ 11668us) server_negotiation.cc:407] Connection header received
0924 12:53:11.110096 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.110103 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.110235 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.110371 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:11.113396 (+ 3025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.114577 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.116784 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.117463 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.117576 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.121768 (+ 4192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:11.121773 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:11.121777 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:11.121829 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:11.127107 (+ 5278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.128323 (+ 1216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.128330 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.128334 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.128517 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.129130 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.129136 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.129139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.129507 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:11.129818 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.130933 (+ 1115us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.131221 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13916,"thread_start_us":18319,"threads_started":1}
I20260924 12:53:11.134481 17609 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:53:11.143550 17609 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:53:11.181655 18898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.168593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43500 (local address 127.11.49.67:43695)
0924 12:53:11.173088 (+ 4495us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.173100 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.173146 (+ 46us) server_negotiation.cc:407] Connection header received
0924 12:53:11.173345 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.173359 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.173743 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.174005 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:11.174823 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.176148 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.178663 (+ 2515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.180533 (+ 1870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.180697 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.180999 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.181186 (+ 187us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.181354 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4257,"thread_start_us":4017,"threads_started":1}
I20260924 12:53:11.181706 18897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.168142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:43695 (local address 127.0.0.1:43500)
0924 12:53:11.168952 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:11.168976 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:11.169137 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:11.174093 (+ 4956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:11.174098 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:11.174128 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:11.174578 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.174592 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.176362 (+ 1770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.176371 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.178476 (+ 2105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.178494 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.180786 (+ 2292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.180795 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.180972 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.181004 (+ 32us) client_negotiation.cc:769] Sending connection context
0924 12:53:11.181127 (+ 123us) client_negotiation.cc:240] Negotiation successful
0924 12:53:11.181279 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"mutex_wait_us":2,"thread_start_us":423,"threads_started":1}
I20260924 12:53:11.183907 18899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.169189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:33793 (local address 127.0.0.1:36376)
0924 12:53:11.172386 (+ 3197us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:11.172414 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:11.172607 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:11.174445 (+ 1838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:11.174451 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:11.174490 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:11.174944 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.174959 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.178669 (+ 3710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.178673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.180848 (+ 2175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.180866 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.182819 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.182826 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.183051 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.183095 (+ 44us) client_negotiation.cc:769] Sending connection context
0924 12:53:11.183206 (+ 111us) client_negotiation.cc:240] Negotiation successful
0924 12:53:11.183475 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3015,"mutex_wait_us":35,"thread_start_us":1077,"threads_started":1}
I20260924 12:53:11.183962 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.169820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36376 (local address 127.11.49.66:33793)
0924 12:53:11.173689 (+ 3869us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.173700 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.173731 (+ 31us) server_negotiation.cc:407] Connection header received
0924 12:53:11.173836 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.173843 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.174147 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.175252 (+ 1105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:11.175472 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.177088 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.181166 (+ 4078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.182578 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.182683 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.182826 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.183484 (+ 658us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.183659 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3713,"thread_start_us":3599,"threads_started":1}
I20260924 12:53:11.184746 18901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.169280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33500 (local address 127.11.49.65:38009)
0924 12:53:11.174459 (+ 5179us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.174470 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.174500 (+ 30us) server_negotiation.cc:407] Connection header received
0924 12:53:11.174604 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.174610 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.174819 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.175010 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:11.175702 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.177182 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.179453 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.180740 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.180862 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.181080 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.184218 (+ 3138us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.184439 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3824,"thread_start_us":3710,"threads_started":1}
I20260924 12:53:11.184881 18900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.169022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:38009 (local address 127.0.0.1:33500)
0924 12:53:11.169820 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:11.169839 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:11.169951 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:11.174993 (+ 5042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:11.174998 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:11.175028 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:11.175481 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.175494 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.177331 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.177335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.179299 (+ 1964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.179311 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.182954 (+ 3643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.182958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.183148 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.183179 (+ 31us) client_negotiation.cc:769] Sending connection context
0924 12:53:11.183278 (+ 99us) client_negotiation.cc:240] Negotiation successful
0924 12:53:11.184500 (+ 1222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"mutex_wait_us":1001,"thread_start_us":3010,"threads_started":1}
I20260924 12:53:11.186163 18801 tablet_service.cc:1467] Processing CreateTablet for tablet b52a8c6f95f741e0a4b322558fa9b0e5 (DEFAULT_TABLE table=test-table [id=5ff9bdccd6c5431fa1c998b7e930b0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:11.187405 18801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b52a8c6f95f741e0a4b322558fa9b0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:11.191745 18660 tablet_service.cc:1467] Processing CreateTablet for tablet b52a8c6f95f741e0a4b322558fa9b0e5 (DEFAULT_TABLE table=test-table [id=5ff9bdccd6c5431fa1c998b7e930b0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:11.192942 18660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b52a8c6f95f741e0a4b322558fa9b0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:11.192926 18514 tablet_service.cc:1467] Processing CreateTablet for tablet b52a8c6f95f741e0a4b322558fa9b0e5 (DEFAULT_TABLE table=test-table [id=5ff9bdccd6c5431fa1c998b7e930b0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:11.194485 18514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b52a8c6f95f741e0a4b322558fa9b0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:11.208033 18903 tablet_bootstrap.cc:492] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: Bootstrap starting.
I20260924 12:53:11.211193 18904 tablet_bootstrap.cc:492] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: Bootstrap starting.
I20260924 12:53:11.211642 18903 tablet_bootstrap.cc:654] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:11.213006 18903 log.cc:824] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:11.215051 18904 tablet_bootstrap.cc:654] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:11.216670 18904 log.cc:824] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:11.219934 18907 tablet_bootstrap.cc:492] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: Bootstrap starting.
I20260924 12:53:11.220626 18904 tablet_bootstrap.cc:492] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: No bootstrap required, opened a new log
I20260924 12:53:11.220959 18904 ts_tablet_manager.cc:1397] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260924 12:53:11.222324 18903 tablet_bootstrap.cc:492] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: No bootstrap required, opened a new log
I20260924 12:53:11.222606 18903 ts_tablet_manager.cc:1397] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.000s
I20260924 12:53:11.224170 18907 tablet_bootstrap.cc:654] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:11.226663 18907 log.cc:824] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:11.230707 18907 tablet_bootstrap.cc:492] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: No bootstrap required, opened a new log
I20260924 12:53:11.231142 18907 ts_tablet_manager.cc:1397] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260924 12:53:11.232411 18904 raft_consensus.cc:348] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } } peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } }
I20260924 12:53:11.233139 18904 raft_consensus.cc:374] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:11.233268 18904 raft_consensus.cc:729] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12dfc0d55448464ab20e07e9de4d07ac, State: Initialized, Role: FOLLOWER
I20260924 12:53:11.233532 18903 raft_consensus.cc:348] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } } peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } }
I20260924 12:53:11.233979 18903 raft_consensus.cc:374] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:11.234126 18903 raft_consensus.cc:729] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cdad6dae8934f2cbee30e01112c39df, State: Initialized, Role: FOLLOWER
I20260924 12:53:11.234071 18904 consensus_queue.cc:260] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } } peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } }
I20260924 12:53:11.234859 18903 consensus_queue.cc:260] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } } peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } }
I20260924 12:53:11.236390 18904 ts_tablet_manager.cc:1428] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260924 12:53:11.243176 18903 ts_tablet_manager.cc:1428] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: Time spent starting tablet: real 0.020s user 0.013s sys 0.008s
I20260924 12:53:11.243603 18867 heartbeater.cc:503] Master 127.11.49.126:40841 was elected leader, sending a full tablet report...
W20260924 12:53:11.244002 18582 tablet.cc:2369] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:53:11.243012 18907 raft_consensus.cc:348] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } } peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } }
I20260924 12:53:11.244799 18907 raft_consensus.cc:374] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:11.244954 18907 raft_consensus.cc:729] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e5d98186f4b40a3e8f31efba815f8, State: Initialized, Role: FOLLOWER
I20260924 12:53:11.245836 18907 consensus_queue.cc:260] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } } peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } }
I20260924 12:53:11.251543 18726 heartbeater.cc:503] Master 127.11.49.126:40841 was elected leader, sending a full tablet report...
I20260924 12:53:11.251904 18907 ts_tablet_manager.cc:1428] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: Time spent starting tablet: real 0.021s user 0.011s sys 0.009s
W20260924 12:53:11.290524 18728 tablet.cc:2369] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:53:11.300650 18869 tablet.cc:2369] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:53:11.313409 18910 raft_consensus.cc:482] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:53:11.313766 18910 raft_consensus.cc:504] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } } peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } }
I20260924 12:53:11.315696 18910 leader_election.cc:288] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12dfc0d55448464ab20e07e9de4d07ac (127.11.49.65:38009), 218e5d98186f4b40a3e8f31efba815f8 (127.11.49.66:33793)
I20260924 12:53:11.325073 18901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.316172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:45571 (local address 127.11.49.65:38009)
0924 12:53:11.316440 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.316447 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.316733 (+ 286us) server_negotiation.cc:407] Connection header received
0924 12:53:11.316970 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.316976 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.317059 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.317206 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:11.317896 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.319043 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.322218 (+ 3175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.323529 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.323750 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.323813 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.324684 (+ 871us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.324815 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260924 12:53:11.325074 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.316438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:55471 (local address 127.11.49.66:33793)
0924 12:53:11.316689 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.316698 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.316889 (+ 191us) server_negotiation.cc:407] Connection header received
0924 12:53:11.316971 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.316976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.317105 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.317205 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:11.317896 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.319004 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.322218 (+ 3214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.323529 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.323736 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.323813 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.324636 (+ 823us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.324782 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260924 12:53:11.325497 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.316127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:38009 (local address 127.11.49.67:45571)
0924 12:53:11.316471 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:11.316508 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:11.316721 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:11.317252 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:11.317257 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:11.317300 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:11.317712 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.317725 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.319214 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.319218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.321950 (+ 2732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.321975 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.323809 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.323817 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.324436 (+ 619us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.324462 (+ 26us) client_negotiation.cc:769] Sending connection context
0924 12:53:11.324567 (+ 105us) client_negotiation.cc:240] Negotiation successful
0924 12:53:11.324982 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":443,"spinlock_wait_cycles":9088}
I20260924 12:53:11.325932 18872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.316210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:33793 (local address 127.11.49.67:55471)
0924 12:53:11.316754 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:11.316771 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:11.316869 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:11.317252 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:11.317257 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:11.317298 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:11.317713 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.317725 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.319206 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.319213 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.321950 (+ 2737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:11.321975 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.323809 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.323817 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:11.324361 (+ 544us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.324445 (+ 84us) client_negotiation.cc:769] Sending connection context
0924 12:53:11.324565 (+ 120us) client_negotiation.cc:240] Negotiation successful
0924 12:53:11.324982 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":712,"spinlock_wait_cycles":8064}
I20260924 12:53:11.326968 18534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b52a8c6f95f741e0a4b322558fa9b0e5" candidate_uuid: "9cdad6dae8934f2cbee30e01112c39df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12dfc0d55448464ab20e07e9de4d07ac" is_pre_election: true
I20260924 12:53:11.327174 18680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b52a8c6f95f741e0a4b322558fa9b0e5" candidate_uuid: "9cdad6dae8934f2cbee30e01112c39df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e5d98186f4b40a3e8f31efba815f8" is_pre_election: true
I20260924 12:53:11.327581 18534 raft_consensus.cc:2454] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cdad6dae8934f2cbee30e01112c39df in term 0.
I20260924 12:53:11.327937 18680 raft_consensus.cc:2454] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cdad6dae8934f2cbee30e01112c39df in term 0.
I20260924 12:53:11.328733 18755 leader_election.cc:302] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12dfc0d55448464ab20e07e9de4d07ac, 9cdad6dae8934f2cbee30e01112c39df; no voters:
I20260924 12:53:11.329341 18910 raft_consensus.cc:2781] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:53:11.329576 18910 raft_consensus.cc:482] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:53:11.329720 18910 raft_consensus.cc:3037] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:11.332073 18910 raft_consensus.cc:504] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } } peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } }
I20260924 12:53:11.332764 18910 leader_election.cc:288] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [CANDIDATE]: Term 1 election: Requested vote from peers 12dfc0d55448464ab20e07e9de4d07ac (127.11.49.65:38009), 218e5d98186f4b40a3e8f31efba815f8 (127.11.49.66:33793)
I20260924 12:53:11.333595 18680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b52a8c6f95f741e0a4b322558fa9b0e5" candidate_uuid: "9cdad6dae8934f2cbee30e01112c39df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e5d98186f4b40a3e8f31efba815f8"
I20260924 12:53:11.333597 18534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b52a8c6f95f741e0a4b322558fa9b0e5" candidate_uuid: "9cdad6dae8934f2cbee30e01112c39df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12dfc0d55448464ab20e07e9de4d07ac"
I20260924 12:53:11.333891 18680 raft_consensus.cc:3037] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:11.333957 18534 raft_consensus.cc:3037] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:11.337008 18534 raft_consensus.cc:2454] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cdad6dae8934f2cbee30e01112c39df in term 1.
I20260924 12:53:11.337093 18680 raft_consensus.cc:2454] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cdad6dae8934f2cbee30e01112c39df in term 1.
I20260924 12:53:11.337921 18756 leader_election.cc:302] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 12dfc0d55448464ab20e07e9de4d07ac, 218e5d98186f4b40a3e8f31efba815f8, 9cdad6dae8934f2cbee30e01112c39df; no voters:
I20260924 12:53:11.338416 18910 raft_consensus.cc:2781] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:11.339066 18910 raft_consensus.cc:686] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 1 LEADER]: Becoming Leader. State: Replica: 9cdad6dae8934f2cbee30e01112c39df, State: Running, Role: LEADER
I20260924 12:53:11.340623 18910 consensus_queue.cc:237] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } } peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } }
I20260924 12:53:11.346837 17609 catalog_manager.cc:5495] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cdad6dae8934f2cbee30e01112c39df (127.11.49.67). New cstate: current_term: 1 leader_uuid: "9cdad6dae8934f2cbee30e01112c39df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260924 12:53:11.393615 18898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.386777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43516 (local address 127.11.49.67:43695)
0924 12:53:11.387082 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.387090 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.387245 (+ 155us) server_negotiation.cc:407] Connection header received
0924 12:53:11.387560 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.387565 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.387669 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.387868 (+ 199us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:53:11.388326 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.389240 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.390877 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.391339 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.391497 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.392117 (+ 620us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:53:11.392923 (+ 806us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:53:11.393100 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.393185 (+ 85us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.393287 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260924 12:53:11.404847 18680 raft_consensus.cc:1261] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8 [term 1 FOLLOWER]: Refusing update from remote peer 9cdad6dae8934f2cbee30e01112c39df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:11.404909 18534 raft_consensus.cc:1261] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac [term 1 FOLLOWER]: Refusing update from remote peer 9cdad6dae8934f2cbee30e01112c39df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:11.406189 18910 consensus_queue.cc:1035] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [LEADER]: Connected to new peer: Peer: permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:11.406620 18912 consensus_queue.cc:1035] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:11.446664 17608 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:11.446985 17608 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:11.455892 17608 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7948b76170d6434aad3f4d489ee0b03d: Sending DeleteTablet for 3 replicas of tablet b52a8c6f95f741e0a4b322558fa9b0e5
I20260924 12:53:11.457991 18514 tablet_service.cc:1514] Processing DeleteTablet for tablet b52a8c6f95f741e0a4b322558fa9b0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:11 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:33500
I20260924 12:53:11.458022 18660 tablet_service.cc:1514] Processing DeleteTablet for tablet b52a8c6f95f741e0a4b322558fa9b0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:11 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:36376
I20260924 12:53:11.458022 18801 tablet_service.cc:1514] Processing DeleteTablet for tablet b52a8c6f95f741e0a4b322558fa9b0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:11 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:43500
I20260924 12:53:11.458971 18924 tablet_replica.cc:330] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: stopping tablet replica
I20260924 12:53:11.459522 18924 raft_consensus.cc:2229] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:11.460163 18924 raft_consensus.cc:2258] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:11.461290 18926 tablet_replica.cc:330] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: stopping tablet replica
I20260924 12:53:11.463152 18926 raft_consensus.cc:2229] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:11.463812 18926 raft_consensus.cc:2258] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:11.465957 18925 tablet_replica.cc:330] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: stopping tablet replica
I20260924 12:53:11.466415 18925 raft_consensus.cc:2229] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:53:11.467384 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 17577
I20260924 12:53:11.468050 18925 raft_consensus.cc:2258] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:11.468611 17639 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:11.469916 18924 ts_tablet_manager.cc:1905] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:11.470117 18925 ts_tablet_manager.cc:1905] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:11.477670 18926 ts_tablet_manager.cc:1905] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:11.477998 18925 ts_tablet_manager.cc:1918] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:11.478247 18925 log.cc:1196] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/b52a8c6f95f741e0a4b322558fa9b0e5
I20260924 12:53:11.478776 18924 ts_tablet_manager.cc:1918] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:11.479036 18924 log.cc:1196] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/b52a8c6f95f741e0a4b322558fa9b0e5
I20260924 12:53:11.479076 18925 ts_tablet_manager.cc:1939] T b52a8c6f95f741e0a4b322558fa9b0e5 P 9cdad6dae8934f2cbee30e01112c39df: Deleting consensus metadata
I20260924 12:53:11.479729 18924 ts_tablet_manager.cc:1939] T b52a8c6f95f741e0a4b322558fa9b0e5 P 12dfc0d55448464ab20e07e9de4d07ac: Deleting consensus metadata
I20260924 12:53:11.490796 18926 ts_tablet_manager.cc:1918] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:11.490998 18926 log.cc:1196] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/b52a8c6f95f741e0a4b322558fa9b0e5
I20260924 12:53:11.491600 18926 ts_tablet_manager.cc:1939] T b52a8c6f95f741e0a4b322558fa9b0e5 P 218e5d98186f4b40a3e8f31efba815f8: Deleting consensus metadata
I20260924 12:53:11.496469 18882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.461948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50930 (local address 127.11.49.125:45967)
0924 12:53:11.462774 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.462784 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.466267 (+ 3483us) server_negotiation.cc:407] Connection header received
0924 12:53:11.466646 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.466652 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.466762 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.466858 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:11.471082 (+ 4224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.472746 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.475265 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.476024 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.476156 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.482113 (+ 5957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:11.482122 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:11.482130 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:11.482208 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:11.486444 (+ 4236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.493547 (+ 7103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.493555 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.493559 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.493782 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.494375 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.494380 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.494384 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.494868 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:11.495106 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.495830 (+ 724us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.496103 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664}
I20260924 12:53:11.514245 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.466374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60108 (local address 127.11.49.124:36189)
0924 12:53:11.466602 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.466610 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.497488 (+ 30878us) server_negotiation.cc:407] Connection header received
0924 12:53:11.497771 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.497776 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.497873 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.497946 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:11.499878 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.501048 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.502940 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.503596 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.503699 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.507384 (+ 3685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:11.507390 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:11.507396 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:11.507437 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:11.511085 (+ 3648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.511997 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.512006 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.512012 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.512158 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.512645 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.512653 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.512658 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.512961 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:11.513277 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.513567 (+ 290us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.513779 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260924 12:53:11.698446 17595 catalog_manager.cc:4841] TS 218e5d98186f4b40a3e8f31efba815f8 (127.11.49.66:33793): tablet b52a8c6f95f741e0a4b322558fa9b0e5 (table test-table [id=5ff9bdccd6c5431fa1c998b7e930b0c5]) successfully deleted
I20260924 12:53:11.698935 17594 catalog_manager.cc:4841] TS 9cdad6dae8934f2cbee30e01112c39df (127.11.49.67:43695): tablet b52a8c6f95f741e0a4b322558fa9b0e5 (table test-table [id=5ff9bdccd6c5431fa1c998b7e930b0c5]) successfully deleted
I20260924 12:53:11.699285 17594 catalog_manager.cc:4841] TS 12dfc0d55448464ab20e07e9de4d07ac (127.11.49.65:38009): tablet b52a8c6f95f741e0a4b322558fa9b0e5 (table test-table [id=5ff9bdccd6c5431fa1c998b7e930b0c5]) successfully deleted
I20260924 12:53:11.700134 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 17577
I20260924 12:53:11.747352 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.729244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60122 (local address 127.11.49.124:36189)
0924 12:53:11.729532 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.729539 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.730717 (+ 1178us) server_negotiation.cc:407] Connection header received
0924 12:53:11.731054 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.731061 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.731161 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.731284 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:11.733934 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.734979 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.736531 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.737244 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.737394 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.740750 (+ 3356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:11.740756 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:11.740759 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:11.740836 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:11.743815 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.745012 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.745024 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.745026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.745154 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.745606 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.745612 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.745615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.746026 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:11.746201 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.746857 (+ 656us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.747084 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260924 12:53:11.749210 18882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:11.729934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50934 (local address 127.11.49.125:45967)
0924 12:53:11.730124 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:11.730129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:11.730145 (+ 16us) server_negotiation.cc:407] Connection header received
0924 12:53:11.730199 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:11.730203 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:11.730265 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:11.730387 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:11.732586 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.733315 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.735133 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:11.735881 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:11.736052 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:11.740430 (+ 4378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:11.740438 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:11.740444 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:11.740611 (+ 167us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:11.744799 (+ 4188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.746010 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.746016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.746021 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.746235 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:11.746674 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:11.746679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:11.746682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:11.747350 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:11.748119 (+ 769us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:11.748261 (+ 142us) server_negotiation.cc:299] Negotiation successful
0924 12:53:11.748615 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260924 12:53:12.437565 18935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.434323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.66:44099)
0924 12:53:12.437161 (+ 2838us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.437347 (+ 186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2708,"thread_start_us":2590,"threads_started":1}
W20260924 12:53:12.438001 18726 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:40841 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
I20260924 12:53:12.438035 18936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.435273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.67:54007)
0924 12:53:12.437639 (+ 2366us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.437784 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2179,"thread_start_us":2078,"threads_started":1}
W20260924 12:53:12.438613 18867 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:40841 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
I20260924 12:53:12.440886 18937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.439814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.65:60807)
0924 12:53:12.440416 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.440585 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":279,"threads_started":1}
W20260924 12:53:12.441293 18580 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:40841 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
I20260924 12:53:12.956876 18938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7948b76170d6434aad3f4d489ee0b03d)
I20260924 12:53:12.957464 18939 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7948b76170d6434aad3f4d489ee0b03d)
I20260924 12:53:12.957402 18938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } }
I20260924 12:53:12.957733 18939 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } }
I20260924 12:53:12.958999 18939 leader_election.cc:288] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841), 502cf6b751b547f7b1cf2886aea65145 (127.11.49.125:45967)
I20260924 12:53:12.966078 18938 leader_election.cc:288] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841), 8d41c37c4e4042948d4b1c813e179d9c (127.11.49.124:36189)
I20260924 12:53:12.970682 18940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.959272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58314)
0924 12:53:12.970113 (+ 10841us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.970370 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10659,"thread_start_us":9405,"threads_started":1}
I20260924 12:53:12.970911 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.959759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58318)
0924 12:53:12.970464 (+ 10705us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.970670 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10561,"threads_started":1}
W20260924 12:53:12.974370 18386 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
W20260924 12:53:12.974565 18196 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
I20260924 12:53:12.981124 18941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.979693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58340)
0924 12:53:12.980651 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.980871 (+ 220us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":768}
W20260924 12:53:12.981660 18196 leader_election.cc:334] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841): Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
I20260924 12:53:12.984009 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.959824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:36189 (local address 127.0.0.1:60124)
0924 12:53:12.971967 (+ 12143us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.971999 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:12.972172 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:12.973939 (+ 1767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:12.973950 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:12.974014 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:12.974440 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:12.974454 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:12.977139 (+ 2685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:12.977149 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:12.979997 (+ 2848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:12.980012 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:12.983056 (+ 3044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:12.983070 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:12.983282 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:12.983317 (+ 35us) client_negotiation.cc:769] Sending connection context
0924 12:53:12.983384 (+ 67us) client_negotiation.cc:240] Negotiation successful
0924 12:53:12.983567 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12012,"mutex_wait_us":6,"thread_start_us":11676,"threads_started":1}
I20260924 12:53:12.984542 18944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.983405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58350)
0924 12:53:12.983675 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.983905 (+ 230us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260924 12:53:12.984643 18943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.962893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60124 (local address 127.11.49.124:36189)
0924 12:53:12.973548 (+ 10655us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:12.973554 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:12.973572 (+ 18us) server_negotiation.cc:407] Connection header received
0924 12:53:12.973626 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:12.973631 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:12.973710 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:12.973829 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:12.974743 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:12.976858 (+ 2115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:12.980637 (+ 3779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:12.982814 (+ 2177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:12.983689 (+ 875us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:12.983806 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:12.983877 (+ 71us) server_negotiation.cc:299] Negotiation successful
0924 12:53:12.984068 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":383,"server-negotiator.queue_time_us":10536,"thread_start_us":10303,"threads_started":1}
W20260924 12:53:12.984897 18386 leader_election.cc:334] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841): Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
I20260924 12:53:12.985270 18940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.969557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:45967 (local address 127.0.0.1:50936)
0924 12:53:12.970947 (+ 1390us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.970966 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:12.971155 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:12.974905 (+ 3750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:12.974911 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:12.974943 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:12.975622 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:12.975647 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:12.978913 (+ 3266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:12.978924 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:12.982257 (+ 3333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:12.982294 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:12.984262 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:12.984293 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:12.984528 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:12.984565 (+ 37us) client_negotiation.cc:769] Sending connection context
0924 12:53:12.984698 (+ 133us) client_negotiation.cc:240] Negotiation successful
0924 12:53:12.984870 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1284,"mutex_wait_us":1,"thread_start_us":3294,"threads_started":1}
I20260924 12:53:12.985684 18945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.972999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50936 (local address 127.11.49.125:45967)
0924 12:53:12.974552 (+ 1553us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:12.974558 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:12.974579 (+ 21us) server_negotiation.cc:407] Connection header received
0924 12:53:12.974645 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:12.974649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:12.974722 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:12.975859 (+ 1137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:12.976317 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:12.978611 (+ 2294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:12.982605 (+ 3994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:12.983964 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:12.984969 (+ 1005us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:12.985096 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:12.985151 (+ 55us) server_negotiation.cc:299] Negotiation successful
0924 12:53:12.985326 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":1436,"thread_start_us":1187,"threads_started":1}
I20260924 12:53:12.985598 18411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "502cf6b751b547f7b1cf2886aea65145" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8d41c37c4e4042948d4b1c813e179d9c" is_pre_election: true
I20260924 12:53:12.985966 18411 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 502cf6b751b547f7b1cf2886aea65145 in term 1.
I20260924 12:53:12.986387 18220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d41c37c4e4042948d4b1c813e179d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "502cf6b751b547f7b1cf2886aea65145" is_pre_election: true
I20260924 12:53:12.986545 18197 leader_election.cc:302] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 502cf6b751b547f7b1cf2886aea65145, 8d41c37c4e4042948d4b1c813e179d9c; no voters: 7948b76170d6434aad3f4d489ee0b03d
I20260924 12:53:12.986730 18220 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d41c37c4e4042948d4b1c813e179d9c in term 1.
I20260924 12:53:12.987112 18938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260924 12:53:12.987279 18938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7948b76170d6434aad3f4d489ee0b03d)
I20260924 12:53:12.987390 18938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 1 FOLLOWER]: Advancing to term 2
I20260924 12:53:12.987412 18386 leader_election.cc:302] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 502cf6b751b547f7b1cf2886aea65145, 8d41c37c4e4042948d4b1c813e179d9c; no voters: 7948b76170d6434aad3f4d489ee0b03d
I20260924 12:53:12.987743 18939 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260924 12:53:12.987892 18939 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7948b76170d6434aad3f4d489ee0b03d)
I20260924 12:53:12.987975 18939 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 1 FOLLOWER]: Advancing to term 2
I20260924 12:53:12.990273 18938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } }
I20260924 12:53:12.990576 18939 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } }
I20260924 12:53:12.991143 18938 leader_election.cc:288] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [CANDIDATE]: Term 2 election: Requested vote from peers 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841), 8d41c37c4e4042948d4b1c813e179d9c (127.11.49.124:36189)
I20260924 12:53:12.991400 18939 leader_election.cc:288] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 2 election: Requested vote from peers 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841), 502cf6b751b547f7b1cf2886aea65145 (127.11.49.125:45967)
I20260924 12:53:12.991989 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.991306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58354)
0924 12:53:12.991736 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.991832 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267}
I20260924 12:53:12.991902 18411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "502cf6b751b547f7b1cf2886aea65145" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8d41c37c4e4042948d4b1c813e179d9c"
I20260924 12:53:12.992354 18411 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 502cf6b751b547f7b1cf2886aea65145 in current term 2: Already voted for candidate 8d41c37c4e4042948d4b1c813e179d9c in this term.
I20260924 12:53:12.993040 18940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.992495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58364)
0924 12:53:12.992719 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.992845 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260924 12:53:12.993705 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.993248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58378)
0924 12:53:12.993411 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.993511 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260924 12:53:12.993752 18220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d41c37c4e4042948d4b1c813e179d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "502cf6b751b547f7b1cf2886aea65145"
I20260924 12:53:12.994050 18220 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d41c37c4e4042948d4b1c813e179d9c in current term 2: Already voted for candidate 502cf6b751b547f7b1cf2886aea65145 in this term.
W20260924 12:53:12.993999 18196 leader_election.cc:334] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841): Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
I20260924 12:53:12.994267 18196 leader_election.cc:302] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 502cf6b751b547f7b1cf2886aea65145; no voters: 7948b76170d6434aad3f4d489ee0b03d, 8d41c37c4e4042948d4b1c813e179d9c
I20260924 12:53:12.994690 18940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:12.994170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58394)
0924 12:53:12.994441 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:12.994537 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260924 12:53:12.994652 18938 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260924 12:53:12.994894 18386 leader_election.cc:334] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841): Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
I20260924 12:53:12.995170 18386 leader_election.cc:302] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d41c37c4e4042948d4b1c813e179d9c; no voters: 502cf6b751b547f7b1cf2886aea65145, 7948b76170d6434aad3f4d489ee0b03d
I20260924 12:53:12.995491 18939 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260924 12:53:13.439860 18948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:13.438771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.66:59221)
0924 12:53:13.439428 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:13.439567 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":342,"threads_started":1}
I20260924 12:53:13.440748 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:13.439589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.67:50427)
0924 12:53:13.440320 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:13.440477 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":301,"threads_started":1}
I20260924 12:53:13.442951 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:13.442019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.65:54735)
0924 12:53:13.442554 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:13.442680 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":280,"threads_started":1}
I20260924 12:53:14.442080 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.440995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.66:38039)
0924 12:53:14.441639 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.441780 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":319,"threads_started":1}
I20260924 12:53:14.442778 18952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.441900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.67:55717)
0924 12:53:14.442491 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.442598 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":320,"threads_started":1}
I20260924 12:53:14.444734 18953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.443861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.65:46321)
0924 12:53:14.444345 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.444493 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":264,"threads_started":1}
I20260924 12:53:14.786931 18954 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:53:14.787163 18954 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } }
I20260924 12:53:14.788003 18954 leader_election.cc:288] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841), 502cf6b751b547f7b1cf2886aea65145 (127.11.49.125:45967)
I20260924 12:53:14.789438 18955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.788344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58696)
0924 12:53:14.788990 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.789174 (+ 184us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":347,"threads_started":1}
I20260924 12:53:14.789726 18220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d41c37c4e4042948d4b1c813e179d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "502cf6b751b547f7b1cf2886aea65145" is_pre_election: true
I20260924 12:53:14.790019 18220 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d41c37c4e4042948d4b1c813e179d9c in term 2.
I20260924 12:53:14.790891 18386 leader_election.cc:302] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 502cf6b751b547f7b1cf2886aea65145, 8d41c37c4e4042948d4b1c813e179d9c; no voters:
I20260924 12:53:14.791126 18955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.790618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58712)
0924 12:53:14.790782 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.790868 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260924 12:53:14.791292 18386 leader_election.cc:334] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841): Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
I20260924 12:53:14.791344 18954 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260924 12:53:14.791491 18954 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:53:14.791595 18954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 2 FOLLOWER]: Advancing to term 3
I20260924 12:53:14.794032 18954 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } }
I20260924 12:53:14.794806 18954 leader_election.cc:288] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 3 election: Requested vote from peers 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841), 502cf6b751b547f7b1cf2886aea65145 (127.11.49.125:45967)
I20260924 12:53:14.795478 18955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.794987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58718)
0924 12:53:14.795175 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.795319 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260924 12:53:14.795825 18220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d41c37c4e4042948d4b1c813e179d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "502cf6b751b547f7b1cf2886aea65145"
I20260924 12:53:14.796154 18220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 2 FOLLOWER]: Advancing to term 3
I20260924 12:53:14.797091 18955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.796607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58732)
0924 12:53:14.796808 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.796916 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260924 12:53:14.797318 18386 leader_election.cc:334] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841): Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
I20260924 12:53:14.798905 18220 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d41c37c4e4042948d4b1c813e179d9c in term 3.
I20260924 12:53:14.799508 18386 leader_election.cc:302] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 502cf6b751b547f7b1cf2886aea65145, 8d41c37c4e4042948d4b1c813e179d9c; no voters: 7948b76170d6434aad3f4d489ee0b03d
I20260924 12:53:14.800046 18954 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260924 12:53:14.800731 18954 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [term 3 LEADER]: Becoming Leader. State: Replica: 8d41c37c4e4042948d4b1c813e179d9c, State: Running, Role: LEADER
I20260924 12:53:14.801244 18954 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } }
I20260924 12:53:14.803768 18957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d41c37c4e4042948d4b1c813e179d9c. Latest consensus state: current_term: 3 leader_uuid: "8d41c37c4e4042948d4b1c813e179d9c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:14.804128 18957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:14.804947 18959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:53:14.809005 18959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:53:14.809935 18959 catalog_manager.cc:1259] Loaded cluster ID: fbf514c5d25b49c68fa830f42d936032
I20260924 12:53:14.810052 18959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:53:14.811302 18959 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:53:14.812175 18959 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Loaded TSK: 0
I20260924 12:53:14.813120 18959 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:53:14.859885 18401 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60122:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:53:14.868328 18401 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:53:14.874300 18955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.873680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58758)
0924 12:53:14.873897 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.874069 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260924 12:53:14.874818 18220 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [term 3 FOLLOWER]: Refusing update from remote peer 8d41c37c4e4042948d4b1c813e179d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260924 12:53:14.875574 18955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.875132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58764)
0924 12:53:14.875296 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.875385 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260924 12:53:14.875682 18954 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260924 12:53:14.876060 18386 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c -> Peer 7948b76170d6434aad3f4d489ee0b03d (127.11.49.126:40841): Couldn't send request to peer 7948b76170d6434aad3f4d489ee0b03d. Status: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260924 12:53:14.879561 18961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d41c37c4e4042948d4b1c813e179d9c. Latest consensus state: current_term: 3 leader_uuid: "8d41c37c4e4042948d4b1c813e179d9c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:14.879956 18961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:53:14.880828 18960 mvcc.cc:205] Tried to move back new op lower bound from 7332882001395359744 to 7332882001110773760. Current Snapshot: MvccSnapshot[applied={T|T < 7332882001395359744}]
I20260924 12:53:14.881942 18961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "8d41c37c4e4042948d4b1c813e179d9c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:14.882246 18961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 502cf6b751b547f7b1cf2886aea65145 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:53:14.882925 18957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "8d41c37c4e4042948d4b1c813e179d9c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7948b76170d6434aad3f4d489ee0b03d" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40841 } } peers { permanent_uuid: "502cf6b751b547f7b1cf2886aea65145" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 45967 } attrs { promote: false } } peers { permanent_uuid: "8d41c37c4e4042948d4b1c813e179d9c" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 36189 } attrs { promote: false } } }
I20260924 12:53:14.883253 18957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:14.919075 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.893851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33516 (local address 127.11.49.65:38009)
0924 12:53:14.908137 (+ 14286us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:14.908149 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:14.908199 (+ 50us) server_negotiation.cc:407] Connection header received
0924 12:53:14.908369 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:14.908379 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:14.908538 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:14.911011 (+ 2473us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:14.911309 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.912528 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.916322 (+ 3794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.917683 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.917849 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:14.917987 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:14.918444 (+ 457us) server_negotiation.cc:299] Negotiation successful
0924 12:53:14.918665 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14032,"thread_start_us":13860,"threads_started":1}
I20260924 12:53:14.920076 18955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.893560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:38009 (local address 127.0.0.1:33516)
0924 12:53:14.893831 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.893855 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:14.893998 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:14.910163 (+ 16165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:14.910175 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:14.910239 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:14.910766 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:14.910781 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.913199 (+ 2418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.913206 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:14.915756 (+ 2550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:14.915773 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.917917 (+ 2144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.917924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:14.918157 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:14.918232 (+ 75us) client_negotiation.cc:769] Sending connection context
0924 12:53:14.918351 (+ 119us) client_negotiation.cc:240] Negotiation successful
0924 12:53:14.918557 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":4}
I20260924 12:53:14.920578 18971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.895318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36378 (local address 127.11.49.66:33793)
0924 12:53:14.910974 (+ 15656us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:14.910981 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:14.912505 (+ 1524us) server_negotiation.cc:407] Connection header received
0924 12:53:14.912653 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:14.912662 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:14.912783 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:14.912927 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:14.914012 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.914757 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.917270 (+ 2513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.918509 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.918646 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:14.918754 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:14.920058 (+ 1304us) server_negotiation.cc:299] Negotiation successful
0924 12:53:14.920198 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15446,"thread_start_us":15663,"threads_started":1}
I20260924 12:53:14.920894 18969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.894788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:33793 (local address 127.0.0.1:36378)
0924 12:53:14.912354 (+ 17566us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.912373 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:14.912502 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:14.913212 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:14.913218 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:14.913264 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:14.913817 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:14.913828 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.914912 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.914919 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:14.917057 (+ 2138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:14.917073 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.918907 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.918914 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:14.919105 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:14.919149 (+ 44us) client_negotiation.cc:769] Sending connection context
0924 12:53:14.919256 (+ 107us) client_negotiation.cc:240] Negotiation successful
0924 12:53:14.919404 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17423,"mutex_wait_us":28,"thread_start_us":17860,"threads_started":1}
I20260924 12:53:14.921334 18514 tablet_service.cc:1467] Processing CreateTablet for tablet 586a9fac850443d1963c77b3cc13a074 (DEFAULT_TABLE table=test-table [id=ece2513e45084dc69b9cf3413c5d69df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:14.921711 18660 tablet_service.cc:1467] Processing CreateTablet for tablet 586a9fac850443d1963c77b3cc13a074 (DEFAULT_TABLE table=test-table [id=ece2513e45084dc69b9cf3413c5d69df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:14.921940 18514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 586a9fac850443d1963c77b3cc13a074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:14.922192 18660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 586a9fac850443d1963c77b3cc13a074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:14.928200 18972 tablet_bootstrap.cc:492] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8: Bootstrap starting.
I20260924 12:53:14.929802 18973 tablet_bootstrap.cc:492] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac: Bootstrap starting.
I20260924 12:53:14.930663 18968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.894542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:43695 (local address 127.0.0.1:43530)
0924 12:53:14.911670 (+ 17128us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.911699 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:14.911842 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:14.913501 (+ 1659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:14.913506 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:14.913556 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:14.914102 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:14.914119 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.915870 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.915876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:14.918088 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:14.918104 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.920588 (+ 2484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.920595 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:14.929675 (+ 9080us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:14.929734 (+ 59us) client_negotiation.cc:769] Sending connection context
0924 12:53:14.929919 (+ 185us) client_negotiation.cc:240] Negotiation successful
0924 12:53:14.930111 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16968,"mutex_wait_us":1,"thread_start_us":16812,"threads_started":1}
I20260924 12:53:14.931183 18972 tablet_bootstrap.cc:654] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:14.932233 18973 tablet_bootstrap.cc:654] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:14.932356 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.894998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43530 (local address 127.11.49.67:43695)
0924 12:53:14.913107 (+ 18109us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:14.913116 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:14.913137 (+ 21us) server_negotiation.cc:407] Connection header received
0924 12:53:14.913218 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:14.913224 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:14.913325 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:14.914290 (+ 965us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:14.914576 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.915688 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.918307 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:14.919991 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:14.920157 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:14.931639 (+ 11482us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:14.931714 (+ 75us) server_negotiation.cc:299] Negotiation successful
0924 12:53:14.931894 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17943,"thread_start_us":17780,"threads_started":1}
I20260924 12:53:14.933173 18801 tablet_service.cc:1467] Processing CreateTablet for tablet 586a9fac850443d1963c77b3cc13a074 (DEFAULT_TABLE table=test-table [id=ece2513e45084dc69b9cf3413c5d69df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:14.933624 18801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 586a9fac850443d1963c77b3cc13a074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:14.934432 18972 tablet_bootstrap.cc:492] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8: No bootstrap required, opened a new log
I20260924 12:53:14.934607 18972 ts_tablet_manager.cc:1397] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260924 12:53:14.935479 18973 tablet_bootstrap.cc:492] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac: No bootstrap required, opened a new log
I20260924 12:53:14.935465 18972 raft_consensus.cc:348] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } } peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } }
I20260924 12:53:14.935730 18973 ts_tablet_manager.cc:1397] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260924 12:53:14.935812 18972 raft_consensus.cc:374] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:14.935930 18972 raft_consensus.cc:729] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e5d98186f4b40a3e8f31efba815f8, State: Initialized, Role: FOLLOWER
I20260924 12:53:14.936201 18972 consensus_queue.cc:260] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } } peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } }
I20260924 12:53:14.937165 18973 raft_consensus.cc:348] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } } peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } }
I20260924 12:53:14.937480 18973 raft_consensus.cc:374] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:14.937599 18973 raft_consensus.cc:729] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12dfc0d55448464ab20e07e9de4d07ac, State: Initialized, Role: FOLLOWER
I20260924 12:53:14.937928 18973 consensus_queue.cc:260] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } } peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } }
I20260924 12:53:14.938702 18972 ts_tablet_manager.cc:1428] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260924 12:53:14.941051 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.940452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.66:49295)
0924 12:53:14.940716 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.940847 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260924 12:53:14.943944 18725 heartbeater.cc:503] Master 127.11.49.124:36189 was elected leader, sending a full tablet report...
I20260924 12:53:14.947639 18973 ts_tablet_manager.cc:1428] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
I20260924 12:53:14.951018 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.948935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.66:58435)
0924 12:53:14.950598 (+ 1663us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.950743 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1504}
I20260924 12:53:14.951371 18579 heartbeater.cc:503] Master 127.11.49.124:36189 was elected leader, sending a full tablet report...
I20260924 12:53:14.955474 18979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.948477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.65:49837)
0924 12:53:14.955001 (+ 6524us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.955159 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6364,"thread_start_us":6229,"threads_started":1}
I20260924 12:53:14.956831 18978 tablet_bootstrap.cc:492] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df: Bootstrap starting.
I20260924 12:53:14.958742 18978 tablet_bootstrap.cc:654] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:14.961488 18978 tablet_bootstrap.cc:492] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df: No bootstrap required, opened a new log
I20260924 12:53:14.961664 18978 ts_tablet_manager.cc:1397] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260924 12:53:14.962460 18978 raft_consensus.cc:348] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } } peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } }
I20260924 12:53:14.962657 18978 raft_consensus.cc:374] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:14.962782 18978 raft_consensus.cc:729] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cdad6dae8934f2cbee30e01112c39df, State: Initialized, Role: FOLLOWER
I20260924 12:53:14.963022 18978 consensus_queue.cc:260] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } } peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } }
I20260924 12:53:14.963901 18978 ts_tablet_manager.cc:1428] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 12:53:14.965461 18982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.964401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.67:43125)
0924 12:53:14.964925 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.965164 (+ 239us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":739,"threads_started":1}
I20260924 12:53:14.967094 18866 heartbeater.cc:503] Master 127.11.49.124:36189 was elected leader, sending a full tablet report...
I20260924 12:53:14.967397 18982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:14.966245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.67:38163)
0924 12:53:14.967147 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:14.967239 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":720}
I20260924 12:53:15.039923 18977 raft_consensus.cc:482] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:53:15.040184 18977 raft_consensus.cc:504] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } } peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } }
I20260924 12:53:15.042029 18977 leader_election.cc:288] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e5d98186f4b40a3e8f31efba815f8 (127.11.49.66:33793), 9cdad6dae8934f2cbee30e01112c39df (127.11.49.67:43695)
I20260924 12:53:15.049697 18979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.042250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:33793 (local address 127.11.49.65:43359)
0924 12:53:15.042593 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.042621 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:15.042774 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:15.043349 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:15.043355 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:15.043387 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:15.043800 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:15.043815 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.045284 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.045291 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:15.047189 (+ 1898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:15.047202 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.048791 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.048799 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:15.049025 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:15.049053 (+ 28us) client_negotiation.cc:769] Sending connection context
0924 12:53:15.049225 (+ 172us) client_negotiation.cc:240] Negotiation successful
0924 12:53:15.049386 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168}
I20260924 12:53:15.049701 18971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.042573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:43359 (local address 127.11.49.66:33793)
0924 12:53:15.042873 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:15.042883 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:15.042918 (+ 35us) server_negotiation.cc:407] Connection header received
0924 12:53:15.043055 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:15.043060 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:15.043159 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:15.043286 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:15.043972 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.045120 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.047385 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.048232 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.048473 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:15.048571 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:15.049249 (+ 678us) server_negotiation.cc:299] Negotiation successful
0924 12:53:15.049393 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260924 12:53:15.050853 18680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "586a9fac850443d1963c77b3cc13a074" candidate_uuid: "12dfc0d55448464ab20e07e9de4d07ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e5d98186f4b40a3e8f31efba815f8" is_pre_election: true
I20260924 12:53:15.051263 18680 raft_consensus.cc:2454] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12dfc0d55448464ab20e07e9de4d07ac in term 0.
I20260924 12:53:15.052053 18469 leader_election.cc:302] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12dfc0d55448464ab20e07e9de4d07ac, 218e5d98186f4b40a3e8f31efba815f8; no voters:
I20260924 12:53:15.052722 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.042609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:41845 (local address 127.11.49.67:43695)
0924 12:53:15.042820 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:15.042828 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:15.043443 (+ 615us) server_negotiation.cc:407] Connection header received
0924 12:53:15.043721 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:15.043727 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:15.043800 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:15.043902 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:15.045201 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.046333 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.049763 (+ 3430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.051228 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.051432 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:15.051527 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:15.052133 (+ 606us) server_negotiation.cc:299] Negotiation successful
0924 12:53:15.052390 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260924 12:53:15.052872 18977 raft_consensus.cc:2781] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:53:15.053020 18977 raft_consensus.cc:482] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:53:15.053135 18977 raft_consensus.cc:3037] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:15.053289 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.042573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:43695 (local address 127.11.49.65:41845)
0924 12:53:15.043338 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.043360 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:15.043556 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:15.043937 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:15.043941 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:15.044052 (+ 111us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:15.044557 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:15.044575 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.046521 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.046527 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:15.049488 (+ 2961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:15.049510 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.051678 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.051686 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:15.051897 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:15.051924 (+ 27us) client_negotiation.cc:769] Sending connection context
0924 12:53:15.052084 (+ 160us) client_negotiation.cc:240] Negotiation successful
0924 12:53:15.052297 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"mutex_wait_us":1,"thread_start_us":388,"threads_started":1}
I20260924 12:53:15.054217 18821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "586a9fac850443d1963c77b3cc13a074" candidate_uuid: "12dfc0d55448464ab20e07e9de4d07ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cdad6dae8934f2cbee30e01112c39df" is_pre_election: true
I20260924 12:53:15.054675 18821 raft_consensus.cc:2454] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12dfc0d55448464ab20e07e9de4d07ac in term 0.
I20260924 12:53:15.056859 18977 raft_consensus.cc:504] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } } peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } }
I20260924 12:53:15.057796 18977 leader_election.cc:288] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [CANDIDATE]: Term 1 election: Requested vote from peers 218e5d98186f4b40a3e8f31efba815f8 (127.11.49.66:33793), 9cdad6dae8934f2cbee30e01112c39df (127.11.49.67:43695)
I20260924 12:53:15.058435 18821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "586a9fac850443d1963c77b3cc13a074" candidate_uuid: "12dfc0d55448464ab20e07e9de4d07ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cdad6dae8934f2cbee30e01112c39df"
I20260924 12:53:15.058522 18680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "586a9fac850443d1963c77b3cc13a074" candidate_uuid: "12dfc0d55448464ab20e07e9de4d07ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e5d98186f4b40a3e8f31efba815f8"
I20260924 12:53:15.058681 18821 raft_consensus.cc:3037] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:15.058787 18680 raft_consensus.cc:3037] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:15.061584 18821 raft_consensus.cc:2454] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12dfc0d55448464ab20e07e9de4d07ac in term 1.
I20260924 12:53:15.061954 18680 raft_consensus.cc:2454] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12dfc0d55448464ab20e07e9de4d07ac in term 1.
I20260924 12:53:15.062219 18468 leader_election.cc:302] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12dfc0d55448464ab20e07e9de4d07ac, 9cdad6dae8934f2cbee30e01112c39df; no voters:
I20260924 12:53:15.062714 18977 raft_consensus.cc:2781] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:15.063345 18977 raft_consensus.cc:686] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 1 LEADER]: Becoming Leader. State: Replica: 12dfc0d55448464ab20e07e9de4d07ac, State: Running, Role: LEADER
I20260924 12:53:15.064150 18977 consensus_queue.cc:237] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } } peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } }
I20260924 12:53:15.064658 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.064021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.65:60071)
0924 12:53:15.064298 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.064426 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260924 12:53:15.069101 18401 catalog_manager.cc:5495] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 12dfc0d55448464ab20e07e9de4d07ac (127.11.49.65). New cstate: current_term: 1 leader_uuid: "12dfc0d55448464ab20e07e9de4d07ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12dfc0d55448464ab20e07e9de4d07ac" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260924 12:53:15.129109 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.121877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33530 (local address 127.11.49.65:38009)
0924 12:53:15.122089 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:15.122094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:15.122117 (+ 23us) server_negotiation.cc:407] Connection header received
0924 12:53:15.122223 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:15.122227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:15.122315 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:15.122473 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:53:15.122913 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.123715 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.126022 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.126827 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.126975 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:15.127535 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:53:15.128402 (+ 867us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:53:15.128567 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:15.128688 (+ 121us) server_negotiation.cc:299] Negotiation successful
0924 12:53:15.128796 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260924 12:53:15.135037 18680 raft_consensus.cc:1261] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8 [term 1 FOLLOWER]: Refusing update from remote peer 12dfc0d55448464ab20e07e9de4d07ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:15.135294 18821 raft_consensus.cc:1261] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df [term 1 FOLLOWER]: Refusing update from remote peer 12dfc0d55448464ab20e07e9de4d07ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:15.136086 18984 consensus_queue.cc:1035] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e5d98186f4b40a3e8f31efba815f8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:15.136617 18977 consensus_queue.cc:1035] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cdad6dae8934f2cbee30e01112c39df" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:15.139415 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.138905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.66:57839)
0924 12:53:15.139090 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.139208 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260924 12:53:15.140969 18982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.140093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.67:36349)
0924 12:53:15.140358 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.140571 (+ 213us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260924 12:53:15.153396 18987 mvcc.cc:205] Tried to move back new op lower bound from 7332882002463444992 to 7332882002188750848. Current Snapshot: MvccSnapshot[applied={T|T < 7332882002463444992}]
I20260924 12:53:15.155797 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.154773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.66:45133)
0924 12:53:15.155363 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.155501 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422}
I20260924 12:53:15.158841 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.158028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.65:56245)
0924 12:53:15.158470 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.158603 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":297}
I20260924 12:53:15.166749 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.166224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.65:49355)
0924 12:53:15.166413 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.166548 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260924 12:53:15.166965 18982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.166462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.11.49.67:44185)
0924 12:53:15.166697 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.166799 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260924 12:53:15.176260 18400 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:15.176666 18400 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:15.185214 18400 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c: Sending DeleteTablet for 3 replicas of tablet 586a9fac850443d1963c77b3cc13a074
I20260924 12:53:15.186722 18660 tablet_service.cc:1514] Processing DeleteTablet for tablet 586a9fac850443d1963c77b3cc13a074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:15 UTC) from {username='oryx', principal='oryx/127.11.49.124@KRBTEST.COM'} at 127.0.0.1:36378
I20260924 12:53:15.187242 18801 tablet_service.cc:1514] Processing DeleteTablet for tablet 586a9fac850443d1963c77b3cc13a074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:15 UTC) from {username='oryx', principal='oryx/127.11.49.124@KRBTEST.COM'} at 127.0.0.1:43530
I20260924 12:53:15.187696 18514 tablet_service.cc:1514] Processing DeleteTablet for tablet 586a9fac850443d1963c77b3cc13a074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:15 UTC) from {username='oryx', principal='oryx/127.11.49.124@KRBTEST.COM'} at 127.0.0.1:33516
I20260924 12:53:15.187996 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 18388
I20260924 12:53:15.195019 18998 tablet_replica.cc:330] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac: stopping tablet replica
I20260924 12:53:15.195267 18998 raft_consensus.cc:2229] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:53:15.195950 18998 raft_consensus.cc:2258] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:15.196733 18997 tablet_replica.cc:330] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df: stopping tablet replica
I20260924 12:53:15.196943 18997 raft_consensus.cc:2229] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:15.197292 18997 raft_consensus.cc:2258] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:15.198205 18998 ts_tablet_manager.cc:1905] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:15.198633 18997 ts_tablet_manager.cc:1905] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:15.203339 18996 tablet_replica.cc:330] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8: stopping tablet replica
I20260924 12:53:15.203591 18996 raft_consensus.cc:2229] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:15.207798 18998 ts_tablet_manager.cc:1918] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:15.207921 18997 ts_tablet_manager.cc:1918] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:15.208092 18997 log.cc:1196] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/586a9fac850443d1963c77b3cc13a074
I20260924 12:53:15.208397 18998 log.cc:1196] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/586a9fac850443d1963c77b3cc13a074
I20260924 12:53:15.209095 18998 ts_tablet_manager.cc:1939] T 586a9fac850443d1963c77b3cc13a074 P 12dfc0d55448464ab20e07e9de4d07ac: Deleting consensus metadata
I20260924 12:53:15.208642 18997 ts_tablet_manager.cc:1939] T 586a9fac850443d1963c77b3cc13a074 P 9cdad6dae8934f2cbee30e01112c39df: Deleting consensus metadata
I20260924 12:53:15.210716 18385 catalog_manager.cc:4841] TS 12dfc0d55448464ab20e07e9de4d07ac (127.11.49.65:38009): tablet 586a9fac850443d1963c77b3cc13a074 (table test-table [id=ece2513e45084dc69b9cf3413c5d69df]) successfully deleted
I20260924 12:53:15.211148 18385 catalog_manager.cc:4841] TS 9cdad6dae8934f2cbee30e01112c39df (127.11.49.67:43695): tablet 586a9fac850443d1963c77b3cc13a074 (table test-table [id=ece2513e45084dc69b9cf3413c5d69df]) successfully deleted
I20260924 12:53:15.211628 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.189171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33532 (local address 127.11.49.65:38009)
0924 12:53:15.189490 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:15.189497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:15.190030 (+ 533us) server_negotiation.cc:407] Connection header received
0924 12:53:15.190333 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:15.190340 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:15.190453 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:15.190540 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:15.192902 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.194354 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.196575 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.197387 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.197528 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:15.202014 (+ 4486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:15.202030 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:15.202053 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:15.202115 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:15.207123 (+ 5008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:15.208426 (+ 1303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:15.208438 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:15.208442 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:15.208695 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:15.209259 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:15.209265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:15.209269 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:15.209855 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:15.210174 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:15.210901 (+ 727us) server_negotiation.cc:299] Negotiation successful
0924 12:53:15.211175 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193}
I20260924 12:53:15.212620 18996 raft_consensus.cc:2258] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:15.213654 18574 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:15.214538 18996 ts_tablet_manager.cc:1905] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:15.221922 18996 ts_tablet_manager.cc:1918] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:15.222096 18996 log.cc:1196] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/586a9fac850443d1963c77b3cc13a074
I20260924 12:53:15.222570 18996 ts_tablet_manager.cc:1939] T 586a9fac850443d1963c77b3cc13a074 P 218e5d98186f4b40a3e8f31efba815f8: Deleting consensus metadata
I20260924 12:53:15.223978 18386 catalog_manager.cc:4841] TS 218e5d98186f4b40a3e8f31efba815f8 (127.11.49.66:33793): tablet 586a9fac850443d1963c77b3cc13a074 (table test-table [id=ece2513e45084dc69b9cf3413c5d69df]) successfully deleted
I20260924 12:53:15.320945 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 18388
I20260924 12:53:15.340417 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 18591
I20260924 12:53:15.357918 18971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.341515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36394 (local address 127.11.49.66:33793)
0924 12:53:15.341811 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:15.341818 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:15.341842 (+ 24us) server_negotiation.cc:407] Connection header received
0924 12:53:15.341922 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:15.341927 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:15.342019 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:15.342127 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:15.343548 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.344706 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.346162 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.346634 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.346768 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:15.349985 (+ 3217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:15.350009 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:15.350029 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:15.350087 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:15.353841 (+ 3754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:15.354808 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:15.354817 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:15.354820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:15.355030 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:15.355401 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:15.355405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:15.355407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:15.355864 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:15.356186 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:15.357015 (+ 829us) server_negotiation.cc:299] Negotiation successful
0924 12:53:15.357372 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260924 12:53:15.359107 18720 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:15.367451 18968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.366912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58774)
0924 12:53:15.367110 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.367249 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260924 12:53:15.369071 18968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.368543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40841 (local address 127.0.0.1:58790)
0924 12:53:15.368742 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.368870 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:40841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260924 12:53:15.461781 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 18591
I20260924 12:53:15.482909 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 18738
I20260924 12:53:15.498045 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.483786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43532 (local address 127.11.49.67:43695)
0924 12:53:15.484044 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:15.484052 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:15.484076 (+ 24us) server_negotiation.cc:407] Connection header received
0924 12:53:15.484142 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:15.484146 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:15.484221 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:15.484375 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:15.485692 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.486430 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.487649 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:15.488052 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:15.488207 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:15.491032 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:15.491057 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:15.491073 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:15.491105 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:15.494337 (+ 3232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:15.495276 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:15.495295 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:15.495299 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:15.495432 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:15.495858 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:15.495865 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:15.495868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:15.496247 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:15.496752 (+ 505us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:15.497204 (+ 452us) server_negotiation.cc:299] Negotiation successful
0924 12:53:15.497467 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260924 12:53:15.499039 18861 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:15.646566 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 18738
I20260924 12:53:15.669960 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 18072
I20260924 12:53:15.671402 18240 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:15.819481 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 18072
I20260924 12:53:15.846587 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 18174
I20260924 12:53:15.847605 18968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:15.847056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:45967 (local address 127.0.0.1:50940)
0924 12:53:15.847265 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:15.847384 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:45967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260924 12:53:15.847800 18431 generic_service.cc:196] Checking for leaks (request via RPC)
W20260924 12:53:15.847942 18386 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8d41c37c4e4042948d4b1c813e179d9c -> Peer 502cf6b751b547f7b1cf2886aea65145 (127.11.49.125:45967): Couldn't send request to peer 502cf6b751b547f7b1cf2886aea65145. Status: Network error: Client connection negotiation failed: client connection to 127.11.49.125:45967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260924 12:53:15.992671 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 18174
2026-09-24T12:53:16Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (12866 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:53:16 dist-test-slave-m9hg krb5kdc[19007](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:53:16 dist-test-slave-m9hg krb5kdc[19007](info): set up 2 sockets
Sep 24 12:53:16 dist-test-slave-m9hg krb5kdc[19007](info): commencing operation
krb5kdc: starting...
W20260924 12:53:17.162189 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.003s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:53:17 dist-test-slave-m9hg krb5kdc[19007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:53:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:53:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.126.keytab.
Entry for principal oryx/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.126.keytab.
I20260924 12:53:17.440204 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:39873
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.126.keytab
--principal=oryx/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:45903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:39873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:17.882489 19020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:17.882918 19020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:17.883112 19020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:17.892236 19020 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:53:17.892544 19020 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260924 12:53:17.892637 19020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:17.892750 19020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:17.892835 19020 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:53:17.892958 19020 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:53:17.906196 19020 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:45903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:39873
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.126.keytab
--principal=oryx/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:39873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:17.908052 19020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:17.909965 19020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:17.925390 19026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:17.925334 19025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:17.925303 19028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:17.926316 19020 server_base.cc:1034] running on GCE node
I20260924 12:53:17.927397 19020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:17.929572 19020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:17.930962 19020 hybrid_clock.cc:648] HybridClock initialized: now 1790254397930863 us; error 54 us; skew 500 ppm
I20260924 12:53:17.931497 19020 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:17 dist-test-slave-m9hg krb5kdc[19007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254397, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:17.935986 19020 init.cc:377] Logged in from keytab as oryx/127.11.49.126@KRBTEST.COM (short username oryx)
I20260924 12:53:17.938338 19020 webserver.cc:460] Webserver started at http://127.11.49.126:37393/ using document root <none> and password file <none>
I20260924 12:53:17.939368 19020 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:17.939539 19020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:17.939960 19020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:17.944005 19020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "5ad8c488b3ac491ea94cbcc739de1e15"
format_stamp: "Formatted at 2026-09-24 12:53:17 on dist-test-slave-m9hg"
server_key: "eabfe194eac33e4b87e0698b818d46c5"
server_key_iv: "cce8f1eeb55cecad9103afe855813f1e"
server_key_version: "encryptionkey@0"
I20260924 12:53:17.945274 19020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "5ad8c488b3ac491ea94cbcc739de1e15"
format_stamp: "Formatted at 2026-09-24 12:53:17 on dist-test-slave-m9hg"
server_key: "eabfe194eac33e4b87e0698b818d46c5"
server_key_iv: "cce8f1eeb55cecad9103afe855813f1e"
server_key_version: "encryptionkey@0"
I20260924 12:53:17.952838 19020 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260924 12:53:17.958436 19035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:17.960896 19020 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.001s
I20260924 12:53:17.961169 19020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "5ad8c488b3ac491ea94cbcc739de1e15"
format_stamp: "Formatted at 2026-09-24 12:53:17 on dist-test-slave-m9hg"
server_key: "eabfe194eac33e4b87e0698b818d46c5"
server_key_iv: "cce8f1eeb55cecad9103afe855813f1e"
server_key_version: "encryptionkey@0"
I20260924 12:53:17.961488 19020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:17.986629 19020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:17.992846 19020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:17.993245 19020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:18.023900 19020 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:39873
I20260924 12:53:18.023917 19096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:39873 every 8 connection(s)
I20260924 12:53:18.025902 19020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:53:18.030800 19097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:18.030874 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 19020
I20260924 12:53:18.031203 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:53:18.032183 11461 external_mini_cluster.cc:1428] Setting key c095cbbec0e91461adca43a1aba76cef
I20260924 12:53:18.047480 19097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15: Bootstrap starting.
Sep 24 12:53:18 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:18.051918 19097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:18.053108 19097 log.cc:824] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:18.057042 19097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15: No bootstrap required, opened a new log
I20260924 12:53:18.065658 19100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:18.035262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55824 (local address 127.11.49.126:39873)
0924 12:53:18.036571 (+ 1309us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:18.036588 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:18.036654 (+ 66us) server_negotiation.cc:407] Connection header received
0924 12:53:18.038858 (+ 2204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:18.038908 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:18.039618 (+ 710us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:18.040151 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:18.042234 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:18.044092 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:18.046188 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:18.047402 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:18.047685 (+ 283us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:18.053986 (+ 6301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:18.054002 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:18.054038 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:18.054111 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:18.058679 (+ 4568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:18.060091 (+ 1412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:18.060100 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:18.060110 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:18.060465 (+ 355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:18.060997 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:18.061003 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:18.061006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:18.061765 (+ 759us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:18.062207 (+ 442us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:18.062923 (+ 716us) server_negotiation.cc:299] Negotiation successful
0924 12:53:18.063671 (+ 748us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1002,"thread_start_us":612,"threads_started":1}
I20260924 12:53:18.067153 19097 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad8c488b3ac491ea94cbcc739de1e15" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39873 } }
I20260924 12:53:18.067759 19097 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:18.067907 19097 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad8c488b3ac491ea94cbcc739de1e15, State: Initialized, Role: FOLLOWER
I20260924 12:53:18.068704 19097 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad8c488b3ac491ea94cbcc739de1e15" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39873 } }
I20260924 12:53:18.068993 19097 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:53:18.069188 19097 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:53:18.069408 19097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:18.071997 19097 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad8c488b3ac491ea94cbcc739de1e15" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39873 } }
I20260924 12:53:18.072677 19097 leader_election.cc:302] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ad8c488b3ac491ea94cbcc739de1e15; no voters:
I20260924 12:53:18.073410 19097 leader_election.cc:288] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:53:18.073704 19102 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:18.074767 19102 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [term 1 LEADER]: Becoming Leader. State: Replica: 5ad8c488b3ac491ea94cbcc739de1e15, State: Running, Role: LEADER
I20260924 12:53:18.075484 19102 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad8c488b3ac491ea94cbcc739de1e15" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39873 } }
I20260924 12:53:18.076447 19097 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:53:18.079457 19104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ad8c488b3ac491ea94cbcc739de1e15. Latest consensus state: current_term: 1 leader_uuid: "5ad8c488b3ac491ea94cbcc739de1e15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad8c488b3ac491ea94cbcc739de1e15" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39873 } } }
I20260924 12:53:18.080008 19104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:18.080621 19103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ad8c488b3ac491ea94cbcc739de1e15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad8c488b3ac491ea94cbcc739de1e15" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 39873 } } }
I20260924 12:53:18.080948 19103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15 [sys.catalog]: This master's current role is: LEADER
W20260924 12:53:18.092862 19118 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 12:53:18.093020 19118 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 12:53:18.093240 19110 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:53:18.096233 19110 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:53:18.107641 19110 catalog_manager.cc:1347] Generated new cluster ID: 3ec6632cc1d943728fcda61a68dc7a30
I20260924 12:53:18.107928 19110 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:53:18.134611 19110 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:53:18.137033 19110 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:53:18.151178 19110 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15: Generated new TSK 0
I20260924 12:53:18.152788 19110 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab.
Entry for principal oryx/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab.
I20260924 12:53:18.221393 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:39873
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab
--principal=oryx/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:45903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:18.598445 19123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:18.598778 19123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:18.598928 19123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:18.607378 19123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:18.607594 19123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:18.607780 19123 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 12:53:18.607947 19123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:53:18.620172 19123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:45903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab
--principal=oryx/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.49.126:39873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:18.622114 19123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:18.623940 19123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:18.641371 19131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:18.641496 19128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:18.641477 19129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:18.642526 19123 server_base.cc:1034] running on GCE node
I20260924 12:53:18.643380 19123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:18.644686 19123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:18.646175 19123 hybrid_clock.cc:648] HybridClock initialized: now 1790254398646067 us; error 61 us; skew 500 ppm
I20260924 12:53:18.646723 19123 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:18 dist-test-slave-m9hg krb5kdc[19007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254398, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:18.651475 19123 init.cc:377] Logged in from keytab as oryx/127.11.49.65@KRBTEST.COM (short username oryx)
I20260924 12:53:18.653702 19123 webserver.cc:460] Webserver started at http://127.11.49.65:34071/ using document root <none> and password file <none>
I20260924 12:53:18.654745 19123 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:18.654922 19123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:18.655369 19123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:18.659797 19123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "ffb91fadb1074e7e98ec460f058e3c56"
format_stamp: "Formatted at 2026-09-24 12:53:18 on dist-test-slave-m9hg"
server_key: "b9a7810a36cc7d13fffa84b042833810"
server_key_iv: "fc385f9f3ac092a251f41f74449c4098"
server_key_version: "encryptionkey@0"
I20260924 12:53:18.661417 19123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "ffb91fadb1074e7e98ec460f058e3c56"
format_stamp: "Formatted at 2026-09-24 12:53:18 on dist-test-slave-m9hg"
server_key: "b9a7810a36cc7d13fffa84b042833810"
server_key_iv: "fc385f9f3ac092a251f41f74449c4098"
server_key_version: "encryptionkey@0"
I20260924 12:53:18.668048 19123 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260924 12:53:18.673367 19138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:18.675573 19123 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260924 12:53:18.675940 19123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "ffb91fadb1074e7e98ec460f058e3c56"
format_stamp: "Formatted at 2026-09-24 12:53:18 on dist-test-slave-m9hg"
server_key: "b9a7810a36cc7d13fffa84b042833810"
server_key_iv: "fc385f9f3ac092a251f41f74449c4098"
server_key_version: "encryptionkey@0"
I20260924 12:53:18.676391 19123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:18.698342 19123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:18.704705 19123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:18.705111 19123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:18.708726 19123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:18.708887 19123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:18.709095 19123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:18.709179 19123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 12:53:18 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254398, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:18.741891 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:18.710501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39873 (local address 127.11.49.65:56621)
0924 12:53:18.711606 (+ 1105us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:18.711671 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:18.714135 (+ 2464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:18.715241 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:18.715258 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:18.716229 (+ 971us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:18.717644 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:18.717688 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:18.719498 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:18.719502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:18.722631 (+ 3129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:18.722654 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:18.724177 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:18.724182 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:18.724607 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:18.725777 (+ 1170us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:18.725817 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:18.730369 (+ 4552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:18.735330 (+ 4961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:18.735349 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:18.735377 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:18.736232 (+ 855us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:18.736858 (+ 626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:18.736864 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:18.736868 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:18.737278 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:18.738190 (+ 912us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:18.738199 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:18.738679 (+ 480us) client_negotiation.cc:769] Sending connection context
0924 12:53:18.739137 (+ 458us) client_negotiation.cc:240] Negotiation successful
0924 12:53:18.739872 (+ 735us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"thread_start_us":491,"threads_started":1}
I20260924 12:53:18.743251 19147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:18.709727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:56621 (local address 127.11.49.126:39873)
0924 12:53:18.710344 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:18.710363 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:18.711845 (+ 1482us) server_negotiation.cc:407] Connection header received
0924 12:53:18.714568 (+ 2723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:18.714579 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:18.714728 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:18.714933 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:18.717953 (+ 3020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:18.719250 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:18.723000 (+ 3750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:18.723593 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:18.723746 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:18.730787 (+ 7041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:18.730798 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:18.730807 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:18.730868 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:18.735078 (+ 4210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:18.736511 (+ 1433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:18.736520 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:18.736525 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:18.736707 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:18.737472 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:18.737483 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:18.737486 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:18.737914 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:18.738094 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:18.742641 (+ 4547us) server_negotiation.cc:299] Negotiation successful
0924 12:53:18.742964 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":287,"threads_started":1}
I20260924 12:53:18.771713 19123 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:36491
I20260924 12:53:18.771724 19258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:36491 every 8 connection(s)
I20260924 12:53:18.773720 19123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:53:18.775949 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 19123
I20260924 12:53:18.776194 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:53:18.777205 11461 external_mini_cluster.cc:1428] Setting key 938dab201ce65739d5d0ae9a68a9123a
I20260924 12:53:18.778873 19244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:18.760394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39873 (local address 127.11.49.65:53171)
0924 12:53:18.761489 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:18.761527 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:18.761826 (+ 299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:18.762336 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:18.762346 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:18.763269 (+ 923us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:18.763849 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:18.763871 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:18.765371 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:18.765379 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:18.767921 (+ 2542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:18.767951 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:18.769106 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:18.769114 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:18.769302 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:18.770241 (+ 939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:18.770276 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:18.771693 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:18.775586 (+ 3893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:18.775592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:18.775596 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:18.776188 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:18.776721 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:18.776726 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:18.776730 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:18.776869 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:18.777508 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:18.777514 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:18.777794 (+ 280us) client_negotiation.cc:769] Sending connection context
0924 12:53:18.777967 (+ 173us) client_negotiation.cc:240] Negotiation successful
0924 12:53:18.778355 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":809,"thread_start_us":553,"threads_started":1}
I20260924 12:53:18.779084 19147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:18.760579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:53171 (local address 127.11.49.126:39873)
0924 12:53:18.760792 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:18.760800 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:18.761711 (+ 911us) server_negotiation.cc:407] Connection header received
0924 12:53:18.762015 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:18.762019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:18.762092 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:18.762223 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:18.764160 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:18.765162 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:18.768215 (+ 3053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:18.768877 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:18.769029 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:18.771941 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:18.771948 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:18.771954 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:18.771998 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:18.775378 (+ 3380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:18.776427 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:18.776431 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:18.776434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:18.776602 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:18.776995 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:18.777002 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:18.777006 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:18.777372 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:18.777534 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:18.778071 (+ 537us) server_negotiation.cc:299] Negotiation successful
0924 12:53:18.778324 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260924 12:53:18.779224 19259 heartbeater.cc:347] Connected to a master server at 127.11.49.126:39873
I20260924 12:53:18.779531 19259 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:18.780783 19259 heartbeater.cc:511] Master 127.11.49.126:39873 requested a full tablet report, sending...
I20260924 12:53:18.783654 19052 ts_manager.cc:194] Registered new tserver with Master: ffb91fadb1074e7e98ec460f058e3c56 (127.11.49.65:36491)
I20260924 12:53:18.785559 19052 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:56621
WARNING: no policy specified for oryx/127.11.49.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab.
Entry for principal oryx/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab.
I20260924 12:53:18.844825 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:39873
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab
--principal=oryx/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:45903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:19.186280 19263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:19.186631 19263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:19.186803 19263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:19.194242 19263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:19.194406 19263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:19.194550 19263 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 12:53:19.194694 19263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:53:19.204849 19263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:45903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab
--principal=oryx/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.49.126:39873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:19.206238 19263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:19.207589 19263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:19.222726 19269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:19.223520 19268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:19.223562 19271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:19.224414 19263 server_base.cc:1034] running on GCE node
I20260924 12:53:19.225471 19263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:19.226856 19263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:19.228148 19263 hybrid_clock.cc:648] HybridClock initialized: now 1790254399228073 us; error 61 us; skew 500 ppm
I20260924 12:53:19.228579 19263 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:19 dist-test-slave-m9hg krb5kdc[19007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:19.232821 19263 init.cc:377] Logged in from keytab as oryx/127.11.49.66@KRBTEST.COM (short username oryx)
I20260924 12:53:19.234948 19263 webserver.cc:460] Webserver started at http://127.11.49.66:35963/ using document root <none> and password file <none>
I20260924 12:53:19.235934 19263 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:19.236092 19263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:19.236552 19263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:19.240365 19263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "0aa41e5dca4549f0ac13b05276d4a544"
format_stamp: "Formatted at 2026-09-24 12:53:19 on dist-test-slave-m9hg"
server_key: "75f78f7a7dfb8db19dbbca2745f00eda"
server_key_iv: "b6713d84787ebaea82e7d2b7503a11f6"
server_key_version: "encryptionkey@0"
I20260924 12:53:19.241480 19263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "0aa41e5dca4549f0ac13b05276d4a544"
format_stamp: "Formatted at 2026-09-24 12:53:19 on dist-test-slave-m9hg"
server_key: "75f78f7a7dfb8db19dbbca2745f00eda"
server_key_iv: "b6713d84787ebaea82e7d2b7503a11f6"
server_key_version: "encryptionkey@0"
I20260924 12:53:19.249816 19263 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260924 12:53:19.255012 19278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:19.257237 19263 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260924 12:53:19.257577 19263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "0aa41e5dca4549f0ac13b05276d4a544"
format_stamp: "Formatted at 2026-09-24 12:53:19 on dist-test-slave-m9hg"
server_key: "75f78f7a7dfb8db19dbbca2745f00eda"
server_key_iv: "b6713d84787ebaea82e7d2b7503a11f6"
server_key_version: "encryptionkey@0"
I20260924 12:53:19.257939 19263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:19.277012 19263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:19.283085 19263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:19.283443 19263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:19.287838 19263 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:19.288020 19263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:19.288298 19263 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:19.288491 19263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
Sep 24 12:53:19 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:19.315367 19286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:19.287991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:42957 (local address 127.11.49.126:39873)
0924 12:53:19.288576 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:19.288583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:19.290073 (+ 1490us) server_negotiation.cc:407] Connection header received
0924 12:53:19.292438 (+ 2365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:19.292444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:19.292565 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:19.292690 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:19.294963 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:19.296510 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:19.299693 (+ 3183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:19.300637 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:19.300879 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:19.306086 (+ 5207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:19.306098 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:19.306106 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:19.306173 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:19.311608 (+ 5435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:19.312767 (+ 1159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:19.312774 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:19.312778 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:19.312978 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:19.313446 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:19.313451 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:19.313456 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:19.313754 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:19.313934 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:19.314695 (+ 761us) server_negotiation.cc:299] Negotiation successful
0924 12:53:19.314979 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":306,"threads_started":1}
I20260924 12:53:19.316493 19288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:19.288784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39873 (local address 127.11.49.66:42957)
0924 12:53:19.289844 (+ 1060us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:19.289893 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:19.292079 (+ 2186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:19.292967 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:19.292976 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:19.293596 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:19.294584 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:19.294660 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:19.296832 (+ 2172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:19.296838 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:19.299393 (+ 2555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:19.299412 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:19.300983 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:19.300989 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:19.301211 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:19.302374 (+ 1163us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:19.302422 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:19.305700 (+ 3278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:19.311901 (+ 6201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:19.311910 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:19.311926 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:19.312540 (+ 614us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:19.313113 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:19.313118 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:19.313122 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:19.313320 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:19.313904 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:19.313913 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:19.314307 (+ 394us) client_negotiation.cc:769] Sending connection context
0924 12:53:19.314580 (+ 273us) client_negotiation.cc:240] Negotiation successful
0924 12:53:19.315128 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":487,"threads_started":1}
I20260924 12:53:19.351610 19286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:19.331870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:37973 (local address 127.11.49.126:39873)
0924 12:53:19.332174 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:19.332185 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:19.333044 (+ 859us) server_negotiation.cc:407] Connection header received
0924 12:53:19.333187 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:19.333198 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:19.333342 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:19.333549 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:19.335255 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:19.336222 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:19.339669 (+ 3447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:19.340262 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:19.340456 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:19.344760 (+ 4304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:19.344771 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:19.344778 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:19.344844 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:19.348690 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:19.349552 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:19.349558 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:19.349561 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:19.349694 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:19.350066 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:19.350073 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:19.350075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:19.350417 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:19.350572 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:19.351001 (+ 429us) server_negotiation.cc:299] Negotiation successful
0924 12:53:19.351253 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260924 12:53:19.351768 19359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:19.331796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39873 (local address 127.11.49.66:37973)
0924 12:53:19.332885 (+ 1089us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:19.332905 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:19.333046 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:19.333625 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:19.333628 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:19.334332 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:19.335037 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:19.335050 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:19.336515 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:19.336530 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:19.339352 (+ 2822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:19.339401 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:19.340603 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:19.340614 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:19.340989 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:19.342211 (+ 1222us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:19.342243 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:19.344333 (+ 2090us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:19.348896 (+ 4563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:19.348903 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:19.348913 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:19.349404 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:19.349818 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:19.349823 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:19.349832 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:19.349953 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:19.350549 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:19.350553 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:19.350759 (+ 206us) client_negotiation.cc:769] Sending connection context
0924 12:53:19.350907 (+ 148us) client_negotiation.cc:240] Negotiation successful
0924 12:53:19.351276 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":935,"thread_start_us":764,"threads_started":1}
I20260924 12:53:19.359326 19263 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:46421
I20260924 12:53:19.359361 19398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:46421 every 8 connection(s)
I20260924 12:53:19.361056 19263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:53:19.364010 19399 heartbeater.cc:347] Connected to a master server at 127.11.49.126:39873
I20260924 12:53:19.364343 19399 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:19.364368 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 19263
I20260924 12:53:19.364533 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:53:19.365159 11461 external_mini_cluster.cc:1428] Setting key 5fdda55057d1a79bb791e00d6fda24f0
I20260924 12:53:19.365288 19399 heartbeater.cc:511] Master 127.11.49.126:39873 requested a full tablet report, sending...
I20260924 12:53:19.367174 19052 ts_manager.cc:194] Registered new tserver with Master: 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421)
I20260924 12:53:19.368568 19052 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:42957
WARNING: no policy specified for oryx/127.11.49.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab.
Entry for principal oryx/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab.
I20260924 12:53:19.424347 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:39873
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab
--principal=oryx/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:45903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:53:19.790092 19259 heartbeater.cc:503] Master 127.11.49.126:39873 was elected leader, sending a full tablet report...
W20260924 12:53:19.876431 19403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:19.876910 19403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:19.877120 19403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:19.886489 19403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:19.886693 19403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:19.886873 19403 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 12:53:19.887028 19403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:53:19.900044 19403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:45903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab
--principal=oryx/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.49.126:39873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:19.901966 19403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:19.903733 19403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:19.925352 19409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:19.925362 19408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:19.931475 19411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:19.931775 19403 server_base.cc:1034] running on GCE node
I20260924 12:53:19.932956 19403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:19.934393 19403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:19.935725 19403 hybrid_clock.cc:648] HybridClock initialized: now 1790254399935625 us; error 88 us; skew 500 ppm
I20260924 12:53:19.936153 19403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:19 dist-test-slave-m9hg krb5kdc[19007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:19.940399 19403 init.cc:377] Logged in from keytab as oryx/127.11.49.67@KRBTEST.COM (short username oryx)
I20260924 12:53:19.942920 19403 webserver.cc:460] Webserver started at http://127.11.49.67:34795/ using document root <none> and password file <none>
I20260924 12:53:19.944011 19403 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:19.944173 19403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:19.944625 19403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:19.948786 19403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "9ac740bcbb804b65bcad690e24133627"
format_stamp: "Formatted at 2026-09-24 12:53:19 on dist-test-slave-m9hg"
server_key: "ecdec2d8e6990333d51ac0586b4958f2"
server_key_iv: "5ff2efd5cdf0add8d0c981dce855f09a"
server_key_version: "encryptionkey@0"
I20260924 12:53:19.950191 19403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "9ac740bcbb804b65bcad690e24133627"
format_stamp: "Formatted at 2026-09-24 12:53:19 on dist-test-slave-m9hg"
server_key: "ecdec2d8e6990333d51ac0586b4958f2"
server_key_iv: "5ff2efd5cdf0add8d0c981dce855f09a"
server_key_version: "encryptionkey@0"
I20260924 12:53:19.959592 19403 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.006s sys 0.003s
I20260924 12:53:19.965703 19418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:19.968240 19403 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260924 12:53:19.968586 19403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "9ac740bcbb804b65bcad690e24133627"
format_stamp: "Formatted at 2026-09-24 12:53:19 on dist-test-slave-m9hg"
server_key: "ecdec2d8e6990333d51ac0586b4958f2"
server_key_iv: "5ff2efd5cdf0add8d0c981dce855f09a"
server_key_version: "encryptionkey@0"
I20260924 12:53:19.968923 19403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:19.990779 19403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:19.999612 19403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:20.000029 19403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:20.016494 19403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:20.016812 19403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:20.017242 19403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:20.017513 19403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 12:53:20 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:20.050060 19427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:20.007687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:36183 (local address 127.11.49.126:39873)
0924 12:53:20.015169 (+ 7482us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:20.015177 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:20.015206 (+ 29us) server_negotiation.cc:407] Connection header received
0924 12:53:20.018166 (+ 2960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:20.018177 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:20.018327 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:20.018439 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:20.022070 (+ 3631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:20.023900 (+ 1830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:20.027703 (+ 3803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:20.028797 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:20.028944 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:20.036444 (+ 7500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:20.036457 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:20.036465 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:20.036527 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:20.041922 (+ 5395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:20.043411 (+ 1489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:20.043421 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:20.043427 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:20.043690 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:20.044434 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:20.044443 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:20.044448 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:20.044923 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:20.045104 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:20.048728 (+ 3624us) server_negotiation.cc:299] Negotiation successful
0924 12:53:20.049214 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7310,"thread_start_us":7153,"threads_started":1}
I20260924 12:53:20.052686 19426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:20.006697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39873 (local address 127.11.49.67:36183)
0924 12:53:20.013386 (+ 6689us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:20.013492 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:20.017542 (+ 4050us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:20.019276 (+ 1734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:20.019296 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:20.020517 (+ 1221us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:20.021707 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:20.021745 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:20.024224 (+ 2479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:20.024234 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:20.027405 (+ 3171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:20.027435 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:20.029457 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:20.029468 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:20.029976 (+ 508us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:20.031186 (+ 1210us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:20.031233 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:20.035952 (+ 4719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:20.042220 (+ 6268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:20.042235 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:20.042263 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:20.043168 (+ 905us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:20.043869 (+ 701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:20.043878 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:20.043884 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:20.044223 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:20.045265 (+ 1042us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:20.045282 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:20.046153 (+ 871us) client_negotiation.cc:769] Sending connection context
0924 12:53:20.046633 (+ 480us) client_negotiation.cc:240] Negotiation successful
0924 12:53:20.047499 (+ 866us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6136,"thread_start_us":5727,"threads_started":1}
I20260924 12:53:20.126266 19427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:20.095070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:47833 (local address 127.11.49.126:39873)
0924 12:53:20.095384 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:20.095394 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:20.105253 (+ 9859us) server_negotiation.cc:407] Connection header received
0924 12:53:20.106009 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:20.106017 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:20.106122 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:20.106201 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:20.107945 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:20.109288 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:20.111853 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:20.112652 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:20.112774 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:20.116382 (+ 3608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:20.116393 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:20.116398 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:20.116449 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:20.121507 (+ 5058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:20.123025 (+ 1518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:20.123034 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:20.123040 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:20.123241 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:20.123842 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:20.123858 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:20.123862 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:20.124402 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:20.124636 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:20.125439 (+ 803us) server_negotiation.cc:299] Negotiation successful
0924 12:53:20.125850 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260924 12:53:20.126472 19438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:20.095862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39873 (local address 127.11.49.67:47833)
0924 12:53:20.105048 (+ 9186us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:20.105083 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:20.105820 (+ 737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:20.106428 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:20.106433 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:20.107241 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:20.107715 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:20.107729 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:20.109561 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:20.109566 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:20.111609 (+ 2043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:20.111635 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:20.113194 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:20.113205 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:20.113465 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:20.114391 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:20.114419 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:20.115957 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:20.121829 (+ 5872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:20.121840 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:20.121846 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:20.122766 (+ 920us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:20.123407 (+ 641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:20.123412 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:20.123415 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:20.123575 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:20.124635 (+ 1060us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:20.124639 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:20.124880 (+ 241us) client_negotiation.cc:769] Sending connection context
0924 12:53:20.125211 (+ 331us) client_negotiation.cc:240] Negotiation successful
0924 12:53:20.125934 (+ 723us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8934,"thread_start_us":9403,"threads_started":1}
I20260924 12:53:20.159103 19403 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:45503
I20260924 12:53:20.159152 19538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:45503 every 8 connection(s)
I20260924 12:53:20.160677 19403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:53:20.162518 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 19403
I20260924 12:53:20.162761 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:53:20.163345 11461 external_mini_cluster.cc:1428] Setting key c6f4e8f2ccb32919ff30ea72416372d8
I20260924 12:53:20.164376 19539 heartbeater.cc:347] Connected to a master server at 127.11.49.126:39873
I20260924 12:53:20.164778 19539 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:20.165921 19539 heartbeater.cc:511] Master 127.11.49.126:39873 requested a full tablet report, sending...
I20260924 12:53:20.168011 19052 ts_manager.cc:194] Registered new tserver with Master: 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503)
I20260924 12:53:20.169032 19052 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:36183
I20260924 12:53:20.181183 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 24 12:53:20 dist-test-slave-m9hg krb5kdc[19007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254400, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 24 12:53:20 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:20 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:20.372385 19399 heartbeater.cc:503] Master 127.11.49.126:39873 was elected leader, sending a full tablet report...
I20260924 12:53:21.172724 19539 heartbeater.cc:503] Master 127.11.49.126:39873 was elected leader, sending a full tablet report...
W20260924 12:53:21.362649 19547 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.126s user 0.002s sys 0.014s
W20260924 12:53:21.364331 19427 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:20.230748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55840 (local address 127.11.49.126:39873)
0924 12:53:20.231064 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:20.231120 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:20.231350 (+ 230us) server_negotiation.cc:407] Connection header received
0924 12:53:20.231639 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:20.231650 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:20.231724 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:20.231854 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:20.233320 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:20.234049 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:20.235406 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:20.235849 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:20.235994 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.363893 (+1127899us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55840: BlockingRecv error: recv got EOF from 127.0.0.1:55840 (error 108)
Metrics: {"server-negotiator.queue_time_us":114}
Sep 24 12:53:21 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254400, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:21.392195 19427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.369556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55854 (local address 127.11.49.126:39873)
0924 12:53:21.369800 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:21.369805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:21.369827 (+ 22us) server_negotiation.cc:407] Connection header received
0924 12:53:21.369903 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:21.369907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:21.369975 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:21.370081 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:21.371737 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.372542 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.374175 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.374711 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.374839 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.385887 (+ 11048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:21.385894 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:21.385898 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:21.385944 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:21.389122 (+ 3178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:21.390127 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:21.390131 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:21.390133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:21.390270 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:21.390680 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:21.390684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:21.390686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:21.390961 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:21.391157 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:21.391631 (+ 474us) server_negotiation.cc:299] Negotiation successful
0924 12:53:21.391834 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260924 12:53:21.397636 19052 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:53:21.404865 19052 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:53:21.442669 19558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.419750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:46421 (local address 127.0.0.1:35652)
0924 12:53:21.431671 (+ 11921us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:21.431746 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:21.432066 (+ 320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:21.433788 (+ 1722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:21.433797 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:21.433838 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:21.434394 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.434409 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.436528 (+ 2119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.436534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.439351 (+ 2817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.439363 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.441404 (+ 2041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.441410 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.441645 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.441704 (+ 59us) client_negotiation.cc:769] Sending connection context
0924 12:53:21.441894 (+ 190us) client_negotiation.cc:240] Negotiation successful
0924 12:53:21.442142 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11396,"mutex_wait_us":4,"spinlock_wait_cycles":1408,"thread_start_us":11135,"threads_started":1}
I20260924 12:53:21.443100 19561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.420541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37660 (local address 127.11.49.65:36491)
0924 12:53:21.433103 (+ 12562us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:21.433111 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:21.434151 (+ 1040us) server_negotiation.cc:407] Connection header received
0924 12:53:21.434282 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:21.434292 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:21.434607 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:21.434822 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:21.435816 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.437420 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.440539 (+ 3119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.441875 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.442018 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.442230 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:21.442568 (+ 338us) server_negotiation.cc:299] Negotiation successful
0924 12:53:21.442774 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12387,"thread_start_us":12567,"threads_started":1}
I20260924 12:53:21.443156 19559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.419980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36491 (local address 127.0.0.1:37660)
0924 12:53:21.433847 (+ 13867us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:21.433869 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:21.434016 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:21.435072 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:21.435077 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:21.435103 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:21.435599 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.435611 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.437607 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.437613 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.440345 (+ 2732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.440357 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.442131 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.442138 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.442334 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.442371 (+ 37us) client_negotiation.cc:769] Sending connection context
0924 12:53:21.442496 (+ 125us) client_negotiation.cc:240] Negotiation successful
0924 12:53:21.442676 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13729,"mutex_wait_us":132,"thread_start_us":13532,"threads_started":1}
I20260924 12:53:21.443769 19560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.420379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35652 (local address 127.11.49.66:46421)
0924 12:53:21.432619 (+ 12240us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:21.432632 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:21.432672 (+ 40us) server_negotiation.cc:407] Connection header received
0924 12:53:21.432846 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:21.432856 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:21.433197 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:21.433461 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:21.434620 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.436332 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.439551 (+ 3219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.441158 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.441308 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.441569 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:21.443190 (+ 1621us) server_negotiation.cc:299] Negotiation successful
0924 12:53:21.443458 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12059,"thread_start_us":11930,"threads_started":1}
I20260924 12:53:21.449275 19562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.432591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47098 (local address 127.11.49.67:45503)
0924 12:53:21.437564 (+ 4973us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:21.437578 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:21.438337 (+ 759us) server_negotiation.cc:407] Connection header received
0924 12:53:21.438492 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:21.438502 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:21.438841 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:21.439081 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:21.440048 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.441546 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.446272 (+ 4726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.447930 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.448095 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.448352 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:21.448804 (+ 452us) server_negotiation.cc:299] Negotiation successful
0924 12:53:21.448977 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4795,"thread_start_us":4627,"threads_started":1}
I20260924 12:53:21.448644 19189 tablet_service.cc:1467] Processing CreateTablet for tablet 78ee0896e822407d842cdd396edef6d1 (DEFAULT_TABLE table=test-table [id=7f33d988a27f4b06a626f438f271e8d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:21.448832 19329 tablet_service.cc:1467] Processing CreateTablet for tablet 78ee0896e822407d842cdd396edef6d1 (DEFAULT_TABLE table=test-table [id=7f33d988a27f4b06a626f438f271e8d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:21.449374 19563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.434468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:45503 (local address 127.0.0.1:47098)
0924 12:53:21.437993 (+ 3525us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:21.438010 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:21.438212 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:21.439258 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:21.439264 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:21.439293 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:21.439801 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.439814 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.441684 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.441692 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.446032 (+ 4340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.446055 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.448305 (+ 2250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.448314 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.448537 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.448584 (+ 47us) client_negotiation.cc:769] Sending connection context
0924 12:53:21.448726 (+ 142us) client_negotiation.cc:240] Negotiation successful
0924 12:53:21.448940 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3404,"mutex_wait_us":41,"thread_start_us":3126,"threads_started":1}
I20260924 12:53:21.450392 19189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78ee0896e822407d842cdd396edef6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:21.450685 19329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78ee0896e822407d842cdd396edef6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:21.453948 19474 tablet_service.cc:1467] Processing CreateTablet for tablet 78ee0896e822407d842cdd396edef6d1 (DEFAULT_TABLE table=test-table [id=7f33d988a27f4b06a626f438f271e8d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:21.455401 19474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78ee0896e822407d842cdd396edef6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:21.467676 19565 tablet_bootstrap.cc:492] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: Bootstrap starting.
I20260924 12:53:21.469621 19564 tablet_bootstrap.cc:492] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: Bootstrap starting.
I20260924 12:53:21.472136 19566 tablet_bootstrap.cc:492] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627: Bootstrap starting.
I20260924 12:53:21.473156 19565 tablet_bootstrap.cc:654] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:21.474285 19564 tablet_bootstrap.cc:654] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:21.474900 19565 log.cc:824] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:21.475631 19564 log.cc:824] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:21.476971 19566 tablet_bootstrap.cc:654] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:21.478760 19566 log.cc:824] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:21.480047 19565 tablet_bootstrap.cc:492] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: No bootstrap required, opened a new log
I20260924 12:53:21.480499 19565 ts_tablet_manager.cc:1397] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: Time spent bootstrapping tablet: real 0.013s user 0.012s sys 0.000s
I20260924 12:53:21.482160 19566 tablet_bootstrap.cc:492] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627: No bootstrap required, opened a new log
I20260924 12:53:21.482160 19564 tablet_bootstrap.cc:492] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: No bootstrap required, opened a new log
I20260924 12:53:21.482479 19564 ts_tablet_manager.cc:1397] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.007s
I20260924 12:53:21.482547 19566 ts_tablet_manager.cc:1397] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260924 12:53:21.489679 19565 raft_consensus.cc:348] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.490237 19565 raft_consensus.cc:374] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:21.490362 19565 raft_consensus.cc:729] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb91fadb1074e7e98ec460f058e3c56, State: Initialized, Role: FOLLOWER
I20260924 12:53:21.491194 19565 consensus_queue.cc:260] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.494071 19566 raft_consensus.cc:348] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.494071 19564 raft_consensus.cc:348] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.494587 19564 raft_consensus.cc:374] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:21.494711 19566 raft_consensus.cc:374] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:21.494735 19564 raft_consensus.cc:729] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa41e5dca4549f0ac13b05276d4a544, State: Initialized, Role: FOLLOWER
I20260924 12:53:21.494855 19566 raft_consensus.cc:729] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac740bcbb804b65bcad690e24133627, State: Initialized, Role: FOLLOWER
I20260924 12:53:21.495715 19564 consensus_queue.cc:260] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.495720 19566 consensus_queue.cc:260] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.496330 19565 ts_tablet_manager.cc:1428] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: Time spent starting tablet: real 0.016s user 0.010s sys 0.004s
I20260924 12:53:21.498821 19564 ts_tablet_manager.cc:1428] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: Time spent starting tablet: real 0.016s user 0.012s sys 0.002s
I20260924 12:53:21.501145 19566 ts_tablet_manager.cc:1428] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627: Time spent starting tablet: real 0.018s user 0.014s sys 0.004s
W20260924 12:53:21.528257 19260 tablet.cc:2369] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:53:21.546058 19571 raft_consensus.cc:482] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:53:21.546639 19571 raft_consensus.cc:504] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.549045 19571 leader_election.cc:288] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421), ffb91fadb1074e7e98ec460f058e3c56 (127.11.49.65:36491)
I20260924 12:53:21.557971 19561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.549786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:54379 (local address 127.11.49.65:36491)
0924 12:53:21.550085 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:21.550093 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:21.550354 (+ 261us) server_negotiation.cc:407] Connection header received
0924 12:53:21.550676 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:21.550684 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:21.550800 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:21.550970 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:21.551699 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.552551 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.555385 (+ 2834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.556608 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.556749 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.556806 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:21.557412 (+ 606us) server_negotiation.cc:299] Negotiation successful
0924 12:53:21.557602 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260924 12:53:21.558014 19573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.549451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36491 (local address 127.11.49.67:54379)
0924 12:53:21.550189 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:21.550209 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:21.550416 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:21.551030 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:21.551034 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:21.551068 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:21.551485 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.551494 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.552872 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.552884 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.555087 (+ 2203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.555111 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.556860 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.556868 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.557093 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.557138 (+ 45us) client_negotiation.cc:769] Sending connection context
0924 12:53:21.557264 (+ 126us) client_negotiation.cc:240] Negotiation successful
0924 12:53:21.557441 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"mutex_wait_us":1,"thread_start_us":1153,"threads_started":1}
I20260924 12:53:21.559056 19560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.549788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:33163 (local address 127.11.49.66:46421)
0924 12:53:21.550029 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:21.550034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:21.551230 (+ 1196us) server_negotiation.cc:407] Connection header received
0924 12:53:21.551482 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:21.551488 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:21.551564 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:21.551679 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:21.552334 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.553141 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.556186 (+ 3045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.557564 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.557759 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.557845 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:21.558558 (+ 713us) server_negotiation.cc:299] Negotiation successful
0924 12:53:21.558722 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260924 12:53:21.559118 19574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.549452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:46421 (local address 127.11.49.67:33163)
0924 12:53:21.551073 (+ 1621us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:21.551096 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:21.551305 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:21.551697 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:21.551701 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:21.551727 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:21.552127 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.552137 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.553313 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.553319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.555977 (+ 2658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.555993 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.557981 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.557993 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.558311 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.558357 (+ 46us) client_negotiation.cc:769] Sending connection context
0924 12:53:21.558520 (+ 163us) client_negotiation.cc:240] Negotiation successful
0924 12:53:21.558711 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1431,"mutex_wait_us":191,"thread_start_us":585,"threads_started":1}
I20260924 12:53:21.559538 19209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78ee0896e822407d842cdd396edef6d1" candidate_uuid: "9ac740bcbb804b65bcad690e24133627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb91fadb1074e7e98ec460f058e3c56" is_pre_election: true
I20260924 12:53:21.560199 19209 raft_consensus.cc:2454] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac740bcbb804b65bcad690e24133627 in term 0.
I20260924 12:53:21.560734 19353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78ee0896e822407d842cdd396edef6d1" candidate_uuid: "9ac740bcbb804b65bcad690e24133627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa41e5dca4549f0ac13b05276d4a544" is_pre_election: true
I20260924 12:53:21.561273 19353 raft_consensus.cc:2454] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac740bcbb804b65bcad690e24133627 in term 0.
I20260924 12:53:21.561364 19420 leader_election.cc:302] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac740bcbb804b65bcad690e24133627, ffb91fadb1074e7e98ec460f058e3c56; no voters:
I20260924 12:53:21.562034 19571 raft_consensus.cc:2781] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:53:21.562260 19571 raft_consensus.cc:482] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:53:21.562387 19571 raft_consensus.cc:3037] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:21.565438 19571 raft_consensus.cc:504] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.566298 19571 leader_election.cc:288] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421), ffb91fadb1074e7e98ec460f058e3c56 (127.11.49.65:36491)
I20260924 12:53:21.567144 19209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78ee0896e822407d842cdd396edef6d1" candidate_uuid: "9ac740bcbb804b65bcad690e24133627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb91fadb1074e7e98ec460f058e3c56"
I20260924 12:53:21.567236 19353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78ee0896e822407d842cdd396edef6d1" candidate_uuid: "9ac740bcbb804b65bcad690e24133627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa41e5dca4549f0ac13b05276d4a544"
I20260924 12:53:21.567432 19209 raft_consensus.cc:3037] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:21.567472 19353 raft_consensus.cc:3037] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:21.571346 19209 raft_consensus.cc:2454] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac740bcbb804b65bcad690e24133627 in term 1.
I20260924 12:53:21.571346 19353 raft_consensus.cc:2454] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac740bcbb804b65bcad690e24133627 in term 1.
I20260924 12:53:21.572113 19420 leader_election.cc:302] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac740bcbb804b65bcad690e24133627, ffb91fadb1074e7e98ec460f058e3c56; no voters:
I20260924 12:53:21.572674 19571 raft_consensus.cc:2781] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:21.573369 19571 raft_consensus.cc:686] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 1 LEADER]: Becoming Leader. State: Replica: 9ac740bcbb804b65bcad690e24133627, State: Running, Role: LEADER
I20260924 12:53:21.574043 19571 consensus_queue.cc:237] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.580433 19050 catalog_manager.cc:5495] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ac740bcbb804b65bcad690e24133627 (127.11.49.67). New cstate: current_term: 1 leader_uuid: "9ac740bcbb804b65bcad690e24133627" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } health_report { overall_health: HEALTHY } } }
I20260924 12:53:21.606207 19562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.598768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47100 (local address 127.11.49.67:45503)
0924 12:53:21.598996 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:21.599001 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:21.599059 (+ 58us) server_negotiation.cc:407] Connection header received
0924 12:53:21.599515 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:21.599528 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:21.599635 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:21.599830 (+ 195us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:53:21.600728 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.601468 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.603223 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.603746 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.603903 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.604647 (+ 744us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:53:21.605272 (+ 625us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:53:21.605421 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:21.605832 (+ 411us) server_negotiation.cc:299] Negotiation successful
0924 12:53:21.605942 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260924 12:53:21.614799 19400 tablet.cc:2369] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:53:21.618038 19209 raft_consensus.cc:1261] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Refusing update from remote peer 9ac740bcbb804b65bcad690e24133627: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:21.618038 19353 raft_consensus.cc:1261] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Refusing update from remote peer 9ac740bcbb804b65bcad690e24133627: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:21.619411 19575 consensus_queue.cc:1035] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:21.619860 19571 consensus_queue.cc:1035] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:21.634378 19578 mvcc.cc:205] Tried to move back new op lower bound from 7332882029013856256 to 7332882028852432896. Current Snapshot: MvccSnapshot[applied={T|T < 7332882029013856256}]
I20260924 12:53:21.655396 19052 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:21.655738 19052 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:21.660323 19052 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15: Sending DeleteTablet for 3 replicas of tablet 78ee0896e822407d842cdd396edef6d1
I20260924 12:53:21.661840 19189 tablet_service.cc:1514] Processing DeleteTablet for tablet 78ee0896e822407d842cdd396edef6d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:21 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:37660
I20260924 12:53:21.662173 19474 tablet_service.cc:1514] Processing DeleteTablet for tablet 78ee0896e822407d842cdd396edef6d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:21 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:47098
I20260924 12:53:21.662307 19329 tablet_service.cc:1514] Processing DeleteTablet for tablet 78ee0896e822407d842cdd396edef6d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:21 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:35652
I20260924 12:53:21.664947 19050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:53:21.665920 19050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:53:21.673447 19588 tablet_replica.cc:330] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: stopping tablet replica
I20260924 12:53:21.675401 19588 raft_consensus.cc:2229] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:21.676116 19588 raft_consensus.cc:2258] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:21.680255 19328 tablet_service.cc:1467] Processing CreateTablet for tablet 8f71855d2de748ee97a9096b88f9414f (DEFAULT_TABLE table=test-table [id=c86f2bdf8fc24a4db06b21d20b95d30b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:21.680480 19588 ts_tablet_manager.cc:1905] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:21.681130 19328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f71855d2de748ee97a9096b88f9414f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:21.682554 19590 tablet_replica.cc:330] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: stopping tablet replica
I20260924 12:53:21.684047 19589 tablet_replica.cc:330] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627: stopping tablet replica
I20260924 12:53:21.684468 19589 raft_consensus.cc:2229] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:53:21.684621 19473 tablet_service.cc:1467] Processing CreateTablet for tablet 8f71855d2de748ee97a9096b88f9414f (DEFAULT_TABLE table=test-table [id=c86f2bdf8fc24a4db06b21d20b95d30b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:21.685398 19589 raft_consensus.cc:2258] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:21.685626 19473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f71855d2de748ee97a9096b88f9414f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:21.683254 19590 raft_consensus.cc:2229] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:21.687320 19189 tablet_service.cc:1467] Processing CreateTablet for tablet 8f71855d2de748ee97a9096b88f9414f (DEFAULT_TABLE table=test-table [id=c86f2bdf8fc24a4db06b21d20b95d30b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:21.687973 19189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f71855d2de748ee97a9096b88f9414f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:21.691061 19588 ts_tablet_manager.cc:1918] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:21.693347 19589 ts_tablet_manager.cc:1905] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:21.694525 19588 log.cc:1196] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/78ee0896e822407d842cdd396edef6d1
I20260924 12:53:21.694620 19565 tablet_bootstrap.cc:492] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56: Bootstrap starting.
I20260924 12:53:21.695155 19588 ts_tablet_manager.cc:1939] T 78ee0896e822407d842cdd396edef6d1 P ffb91fadb1074e7e98ec460f058e3c56: Deleting consensus metadata
I20260924 12:53:21.696982 19565 tablet_bootstrap.cc:654] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:21.697273 19037 catalog_manager.cc:4841] TS ffb91fadb1074e7e98ec460f058e3c56 (127.11.49.65:36491): tablet 78ee0896e822407d842cdd396edef6d1 (table test-table [id=7f33d988a27f4b06a626f438f271e8d3]) successfully deleted
I20260924 12:53:21.701351 19589 ts_tablet_manager.cc:1918] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:21.701650 19589 log.cc:1196] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/78ee0896e822407d842cdd396edef6d1
I20260924 12:53:21.702302 19589 ts_tablet_manager.cc:1939] T 78ee0896e822407d842cdd396edef6d1 P 9ac740bcbb804b65bcad690e24133627: Deleting consensus metadata
I20260924 12:53:21.704247 19038 catalog_manager.cc:4841] TS 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503): tablet 78ee0896e822407d842cdd396edef6d1 (table test-table [id=7f33d988a27f4b06a626f438f271e8d3]) successfully deleted
I20260924 12:53:21.705610 19590 raft_consensus.cc:2258] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:21.707540 19565 tablet_bootstrap.cc:492] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56: No bootstrap required, opened a new log
I20260924 12:53:21.707880 19565 ts_tablet_manager.cc:1397] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.006s
I20260924 12:53:21.709249 19565 raft_consensus.cc:348] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.709750 19565 raft_consensus.cc:374] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:21.709944 19565 raft_consensus.cc:729] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb91fadb1074e7e98ec460f058e3c56, State: Initialized, Role: FOLLOWER
I20260924 12:53:21.710237 19566 tablet_bootstrap.cc:492] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627: Bootstrap starting.
I20260924 12:53:21.710498 19565 consensus_queue.cc:260] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.712131 19566 tablet_bootstrap.cc:654] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:21.712128 19590 ts_tablet_manager.cc:1905] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:21.714816 19565 ts_tablet_manager.cc:1428] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260924 12:53:21.717826 19564 tablet_bootstrap.cc:492] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544: Bootstrap starting.
I20260924 12:53:21.719726 19564 tablet_bootstrap.cc:654] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:21.721475 19566 tablet_bootstrap.cc:492] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627: No bootstrap required, opened a new log
I20260924 12:53:21.721762 19566 ts_tablet_manager.cc:1397] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.005s
I20260924 12:53:21.722987 19566 raft_consensus.cc:348] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.723342 19566 raft_consensus.cc:374] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:21.723495 19566 raft_consensus.cc:729] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac740bcbb804b65bcad690e24133627, State: Initialized, Role: FOLLOWER
I20260924 12:53:21.724004 19566 consensus_queue.cc:260] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.726727 19590 ts_tablet_manager.cc:1918] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:21.727087 19590 log.cc:1196] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/78ee0896e822407d842cdd396edef6d1
I20260924 12:53:21.727909 19590 ts_tablet_manager.cc:1939] T 78ee0896e822407d842cdd396edef6d1 P 0aa41e5dca4549f0ac13b05276d4a544: Deleting consensus metadata
I20260924 12:53:21.728307 19566 ts_tablet_manager.cc:1428] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260924 12:53:21.732365 19038 catalog_manager.cc:4841] TS 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421): tablet 78ee0896e822407d842cdd396edef6d1 (table test-table [id=7f33d988a27f4b06a626f438f271e8d3]) successfully deleted
I20260924 12:53:21.733422 19564 tablet_bootstrap.cc:492] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544: No bootstrap required, opened a new log
I20260924 12:53:21.733626 19564 ts_tablet_manager.cc:1397] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.001s
I20260924 12:53:21.734519 19564 raft_consensus.cc:348] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.734781 19564 raft_consensus.cc:374] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:21.734870 19564 raft_consensus.cc:729] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa41e5dca4549f0ac13b05276d4a544, State: Initialized, Role: FOLLOWER
I20260924 12:53:21.735186 19564 consensus_queue.cc:260] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.735996 19564 ts_tablet_manager.cc:1428] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260924 12:53:21.889045 19570 raft_consensus.cc:482] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:53:21.889405 19570 raft_consensus.cc:504] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.891567 19570 leader_election.cc:288] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421), 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503)
I20260924 12:53:21.901439 19560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.892087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:53163 (local address 127.11.49.66:46421)
0924 12:53:21.892342 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:21.892348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:21.892814 (+ 466us) server_negotiation.cc:407] Connection header received
0924 12:53:21.893197 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:21.893209 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:21.893344 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:21.893449 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:21.894818 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.895971 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.899131 (+ 3160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.900117 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.900388 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.900500 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:21.900914 (+ 414us) server_negotiation.cc:299] Negotiation successful
0924 12:53:21.901072 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260924 12:53:21.901490 19594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.891903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:46421 (local address 127.11.49.65:53163)
0924 12:53:21.892668 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:21.892696 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:21.892908 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:21.893825 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:21.893835 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:21.893881 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:21.894514 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.894534 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.896224 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.896232 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.898695 (+ 2463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.898719 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.900459 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.900467 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.900673 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.900704 (+ 31us) client_negotiation.cc:769] Sending connection context
0924 12:53:21.900862 (+ 158us) client_negotiation.cc:240] Negotiation successful
0924 12:53:21.901058 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":426,"threads_started":1}
I20260924 12:53:21.902698 19353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f71855d2de748ee97a9096b88f9414f" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa41e5dca4549f0ac13b05276d4a544" is_pre_election: true
I20260924 12:53:21.903079 19353 raft_consensus.cc:2454] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 0.
I20260924 12:53:21.903834 19141 leader_election.cc:302] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa41e5dca4549f0ac13b05276d4a544, ffb91fadb1074e7e98ec460f058e3c56; no voters:
I20260924 12:53:21.904546 19562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.893214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:49531 (local address 127.11.49.67:45503)
0924 12:53:21.893414 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:21.893424 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:21.895537 (+ 2113us) server_negotiation.cc:407] Connection header received
0924 12:53:21.895932 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:21.895941 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:21.896156 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:21.896336 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:21.897708 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.898872 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.901674 (+ 2802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.903077 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.903284 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.903370 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:21.904007 (+ 637us) server_negotiation.cc:299] Negotiation successful
0924 12:53:21.904177 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260924 12:53:21.904685 19570 raft_consensus.cc:2781] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:53:21.904841 19570 raft_consensus.cc:482] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:53:21.904968 19570 raft_consensus.cc:3037] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:21.905480 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.892904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:45503 (local address 127.11.49.65:49531)
0924 12:53:21.895382 (+ 2478us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:21.895403 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:21.895606 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:21.896873 (+ 1267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:21.896882 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:21.896913 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:21.897482 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.897494 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.899156 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.899163 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.901417 (+ 2254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.901438 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.903566 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.903574 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.903791 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.903836 (+ 45us) client_negotiation.cc:769] Sending connection context
0924 12:53:21.904871 (+ 1035us) client_negotiation.cc:240] Negotiation successful
0924 12:53:21.905066 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2328,"thread_start_us":2077,"threads_started":1}
I20260924 12:53:21.906893 19494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f71855d2de748ee97a9096b88f9414f" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac740bcbb804b65bcad690e24133627" is_pre_election: true
I20260924 12:53:21.907413 19494 raft_consensus.cc:2454] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 0.
I20260924 12:53:21.908535 19570 raft_consensus.cc:504] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.909323 19570 leader_election.cc:288] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421), 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503)
I20260924 12:53:21.910161 19353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f71855d2de748ee97a9096b88f9414f" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa41e5dca4549f0ac13b05276d4a544"
I20260924 12:53:21.910480 19353 raft_consensus.cc:3037] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:21.910526 19494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f71855d2de748ee97a9096b88f9414f" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac740bcbb804b65bcad690e24133627"
I20260924 12:53:21.910797 19494 raft_consensus.cc:3037] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:21.913106 19353 raft_consensus.cc:2454] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 1.
I20260924 12:53:21.913750 19141 leader_election.cc:302] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa41e5dca4549f0ac13b05276d4a544, ffb91fadb1074e7e98ec460f058e3c56; no voters:
I20260924 12:53:21.914197 19570 raft_consensus.cc:2781] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:21.914474 19494 raft_consensus.cc:2454] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 1.
I20260924 12:53:21.914812 19570 raft_consensus.cc:686] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 1 LEADER]: Becoming Leader. State: Replica: ffb91fadb1074e7e98ec460f058e3c56, State: Running, Role: LEADER
W20260924 12:53:21.915486 19540 tablet.cc:2369] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:53:21.915771 19570 consensus_queue.cc:237] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:21.920912 19050 catalog_manager.cc:5495] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffb91fadb1074e7e98ec460f058e3c56 (127.11.49.65). New cstate: current_term: 1 leader_uuid: "ffb91fadb1074e7e98ec460f058e3c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } health_report { overall_health: UNKNOWN } } }
Sep 24 12:53:21 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254397, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.126@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:21.999779 19603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.980123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:39873 (local address 127.0.0.1:55870)
0924 12:53:21.981609 (+ 1486us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:21.981645 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:21.981876 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:21.982516 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:21.982520 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:21.983533 (+ 1013us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:21.983777 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.983787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.985081 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.985089 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.986298 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:21.986312 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.987113 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.987120 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:21.987311 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.988172 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:21.988197 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:21.991298 (+ 3101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:21.996241 (+ 4943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:21.996263 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:21.996363 (+ 100us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:21.997032 (+ 669us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:21.997718 (+ 686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:21.997722 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:21.997725 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:21.997905 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:21.998698 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:21.998705 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:21.998953 (+ 248us) client_negotiation.cc:769] Sending connection context
0924 12:53:21.999121 (+ 168us) client_negotiation.cc:240] Negotiation successful
0924 12:53:21.999418 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1237,"spinlock_wait_cycles":12032,"thread_start_us":728,"threads_started":1}
I20260924 12:53:22.000226 19604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:21.980128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55870 (local address 127.11.49.126:39873)
0924 12:53:21.981534 (+ 1406us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:21.981553 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:21.981784 (+ 231us) server_negotiation.cc:407] Connection header received
0924 12:53:21.982211 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:21.982216 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:21.982292 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:21.982485 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:21.983951 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.984936 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.986460 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:21.986911 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:21.987057 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:21.991697 (+ 4640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:21.991710 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:21.991717 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:21.991782 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:21.995971 (+ 4189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:21.997246 (+ 1275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:21.997253 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:21.997258 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:21.997456 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:21.998073 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:21.998079 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:21.998083 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:21.998519 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:21.998720 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:21.999351 (+ 631us) server_negotiation.cc:299] Negotiation successful
0924 12:53:21.999641 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1173,"thread_start_us":651,"threads_started":1}
I20260924 12:53:22.008114 19050 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:55870:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260924 12:53:22.009601 19050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:53:22.018998 19189 tablet_service.cc:1467] Processing CreateTablet for tablet fa4d1ce60d4e4f899d6ce9f77d99dac6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=844fefd2ff074521a8cac8fa6b97f023]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 12:53:22.019829 19189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4d1ce60d4e4f899d6ce9f77d99dac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:22.020697 19473 tablet_service.cc:1467] Processing CreateTablet for tablet fa4d1ce60d4e4f899d6ce9f77d99dac6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=844fefd2ff074521a8cac8fa6b97f023]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 12:53:22.021365 19473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4d1ce60d4e4f899d6ce9f77d99dac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:22.019694 19328 tablet_service.cc:1467] Processing CreateTablet for tablet fa4d1ce60d4e4f899d6ce9f77d99dac6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=844fefd2ff074521a8cac8fa6b97f023]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 12:53:22.024771 19328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4d1ce60d4e4f899d6ce9f77d99dac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:22.027781 19565 tablet_bootstrap.cc:492] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: Bootstrap starting.
I20260924 12:53:22.030120 19565 tablet_bootstrap.cc:654] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:22.038177 19566 tablet_bootstrap.cc:492] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627: Bootstrap starting.
I20260924 12:53:22.041281 19566 tablet_bootstrap.cc:654] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:22.041750 19565 tablet_bootstrap.cc:492] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: No bootstrap required, opened a new log
I20260924 12:53:22.041983 19565 ts_tablet_manager.cc:1397] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260924 12:53:22.042985 19565 raft_consensus.cc:348] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.043318 19565 raft_consensus.cc:374] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:22.043329 19564 tablet_bootstrap.cc:492] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544: Bootstrap starting.
I20260924 12:53:22.043411 19565 raft_consensus.cc:729] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb91fadb1074e7e98ec460f058e3c56, State: Initialized, Role: FOLLOWER
I20260924 12:53:22.043723 19565 consensus_queue.cc:260] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.044533 19565 ts_tablet_manager.cc:1428] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 12:53:22.044342 19570 tablet_replica.cc:439] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } } }
I20260924 12:53:22.044808 19570 tablet_replica.cc:442] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:53:22.045403 19564 tablet_bootstrap.cc:654] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:22.049315 19564 tablet_bootstrap.cc:492] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544: No bootstrap required, opened a new log
I20260924 12:53:22.049674 19564 ts_tablet_manager.cc:1397] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260924 12:53:22.050832 19564 raft_consensus.cc:348] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.051272 19564 raft_consensus.cc:374] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:22.051519 19564 raft_consensus.cc:729] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa41e5dca4549f0ac13b05276d4a544, State: Initialized, Role: FOLLOWER
I20260924 12:53:22.051968 19564 consensus_queue.cc:260] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.052294 19566 tablet_bootstrap.cc:492] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627: No bootstrap required, opened a new log
I20260924 12:53:22.052531 19566 ts_tablet_manager.cc:1397] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.004s
I20260924 12:53:22.052740 19572 tablet_replica.cc:439] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } } }
I20260924 12:53:22.053225 19572 tablet_replica.cc:442] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:53:22.053520 19566 raft_consensus.cc:348] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.053831 19566 raft_consensus.cc:374] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:22.053939 19566 raft_consensus.cc:729] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac740bcbb804b65bcad690e24133627, State: Initialized, Role: FOLLOWER
I20260924 12:53:22.054126 19564 ts_tablet_manager.cc:1428] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260924 12:53:22.054268 19566 consensus_queue.cc:260] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.055191 19566 ts_tablet_manager.cc:1428] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 12:53:22.054992 19584 tablet_replica.cc:439] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } } }
I20260924 12:53:22.055583 19584 tablet_replica.cc:442] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:53:22.281980 19570 raft_consensus.cc:482] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:53:22.282317 19570 raft_consensus.cc:504] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.283185 19570 leader_election.cc:288] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421), 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503)
I20260924 12:53:22.284005 19353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4d1ce60d4e4f899d6ce9f77d99dac6" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa41e5dca4549f0ac13b05276d4a544" is_pre_election: true
I20260924 12:53:22.284055 19494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4d1ce60d4e4f899d6ce9f77d99dac6" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac740bcbb804b65bcad690e24133627" is_pre_election: true
I20260924 12:53:22.284411 19353 raft_consensus.cc:2454] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 0.
I20260924 12:53:22.284448 19494 raft_consensus.cc:2454] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 0.
I20260924 12:53:22.284978 19141 leader_election.cc:302] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa41e5dca4549f0ac13b05276d4a544, ffb91fadb1074e7e98ec460f058e3c56; no voters:
I20260924 12:53:22.285472 19570 raft_consensus.cc:2781] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:53:22.285604 19570 raft_consensus.cc:482] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:53:22.285740 19570 raft_consensus.cc:3037] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:22.288201 19570 raft_consensus.cc:504] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.288980 19570 leader_election.cc:288] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421), 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503)
I20260924 12:53:22.289659 19353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4d1ce60d4e4f899d6ce9f77d99dac6" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa41e5dca4549f0ac13b05276d4a544"
I20260924 12:53:22.289698 19494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4d1ce60d4e4f899d6ce9f77d99dac6" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac740bcbb804b65bcad690e24133627"
I20260924 12:53:22.289968 19494 raft_consensus.cc:3037] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:22.289949 19353 raft_consensus.cc:3037] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:22.292315 19353 raft_consensus.cc:2454] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 1.
I20260924 12:53:22.292505 19494 raft_consensus.cc:2454] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 1.
I20260924 12:53:22.292930 19141 leader_election.cc:302] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa41e5dca4549f0ac13b05276d4a544, ffb91fadb1074e7e98ec460f058e3c56; no voters:
I20260924 12:53:22.293350 19570 raft_consensus.cc:2781] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:22.293618 19570 raft_consensus.cc:686] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 LEADER]: Becoming Leader. State: Replica: ffb91fadb1074e7e98ec460f058e3c56, State: Running, Role: LEADER
I20260924 12:53:22.293942 19570 consensus_queue.cc:237] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.295851 19596 tablet_replica.cc:439] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: TxnStatusTablet state changed. Reason: New leader ffb91fadb1074e7e98ec460f058e3c56. Latest consensus state: current_term: 1 leader_uuid: "ffb91fadb1074e7e98ec460f058e3c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } } }
I20260924 12:53:22.296216 19596 tablet_replica.cc:442] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: This TxnStatusTablet replica's current role is: LEADER
I20260924 12:53:22.296890 19609 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260924 12:53:22.297158 19609 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260924 12:53:22.297662 19050 catalog_manager.cc:5495] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffb91fadb1074e7e98ec460f058e3c56 (127.11.49.65). New cstate: current_term: 1 leader_uuid: "ffb91fadb1074e7e98ec460f058e3c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } health_report { overall_health: UNKNOWN } } }
I20260924 12:53:22.365023 19603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:22.355278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36491 (local address 127.0.0.1:37674)
0924 12:53:22.355625 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:22.355657 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:22.356005 (+ 348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:22.357132 (+ 1127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:22.357137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:22.357154 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 12:53:22.357470 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:22.357483 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.359299 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.359305 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:22.361028 (+ 1723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:22.361047 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.362386 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.362393 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:22.362636 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:22.362737 (+ 101us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 12:53:22.364340 (+ 1603us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 12:53:22.364364 (+ 24us) client_negotiation.cc:769] Sending connection context
0924 12:53:22.364472 (+ 108us) client_negotiation.cc:240] Negotiation successful
0924 12:53:22.364667 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260924 12:53:22.365126 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:22.355404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37674 (local address 127.11.49.65:36491)
0924 12:53:22.356520 (+ 1116us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:22.356528 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:22.356555 (+ 27us) server_negotiation.cc:407] Connection header received
0924 12:53:22.356704 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:22.356710 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:22.356829 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:22.357092 (+ 263us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:53:22.357708 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.359039 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.361284 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.362155 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.362348 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:22.363027 (+ 679us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:53:22.364096 (+ 1069us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:53:22.364383 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:22.364512 (+ 129us) server_negotiation.cc:299] Negotiation successful
0924 12:53:22.364630 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":941,"thread_start_us":738,"threads_started":1}
I20260924 12:53:22.371467 19353 raft_consensus.cc:1261] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Refusing update from remote peer ffb91fadb1074e7e98ec460f058e3c56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:22.371840 19494 raft_consensus.cc:1261] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Refusing update from remote peer ffb91fadb1074e7e98ec460f058e3c56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:22.372545 19596 consensus_queue.cc:1035] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:22.373015 19570 consensus_queue.cc:1035] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:22.387979 19584 tablet_replica.cc:439] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627: TxnStatusTablet state changed. Reason: New leader ffb91fadb1074e7e98ec460f058e3c56. Latest consensus state: current_term: 1 leader_uuid: "ffb91fadb1074e7e98ec460f058e3c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } } }
I20260924 12:53:22.388468 19584 tablet_replica.cc:442] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:53:22.391069 19613 mvcc.cc:205] Tried to move back new op lower bound from 7332882032104009728 to 7332882031798804480. Current Snapshot: MvccSnapshot[applied={T|T < 7332882032104009728}]
I20260924 12:53:22.393019 19572 tablet_replica.cc:439] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544: TxnStatusTablet state changed. Reason: New leader ffb91fadb1074e7e98ec460f058e3c56. Latest consensus state: current_term: 1 leader_uuid: "ffb91fadb1074e7e98ec460f058e3c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } } }
I20260924 12:53:22.393427 19572 tablet_replica.cc:442] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:53:22.396315 19572 tablet_replica.cc:439] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ffb91fadb1074e7e98ec460f058e3c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } } }
I20260924 12:53:22.396648 19572 tablet_replica.cc:442] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 0aa41e5dca4549f0ac13b05276d4a544: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:53:22.397316 19596 tablet_replica.cc:439] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ffb91fadb1074e7e98ec460f058e3c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } } }
I20260924 12:53:22.398911 19570 tablet_replica.cc:439] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ffb91fadb1074e7e98ec460f058e3c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } } }
I20260924 12:53:22.399236 19596 tablet_replica.cc:442] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: This TxnStatusTablet replica's current role is: LEADER
I20260924 12:53:22.401697 19584 tablet_replica.cc:439] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ffb91fadb1074e7e98ec460f058e3c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } } }
I20260924 12:53:22.401980 19584 tablet_replica.cc:442] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P 9ac740bcbb804b65bcad690e24133627: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 12:53:22.404799 19570 tablet_replica.cc:442] T fa4d1ce60d4e4f899d6ce9f77d99dac6 P ffb91fadb1074e7e98ec460f058e3c56: This TxnStatusTablet replica's current role is: LEADER
I20260924 12:53:22.414518 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:22.407545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37682 (local address 127.11.49.65:36491)
0924 12:53:22.407771 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:22.407778 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:22.407799 (+ 21us) server_negotiation.cc:407] Connection header received
0924 12:53:22.407863 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:22.407867 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:22.407958 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:22.408078 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:53:22.408845 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.410027 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.412354 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.412925 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.413036 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:22.413642 (+ 606us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:53:22.413748 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:53:22.413851 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:22.414092 (+ 241us) server_negotiation.cc:299] Negotiation successful
0924 12:53:22.414169 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260924 12:53:22.420841 19622 consensus_queue.cc:1035] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:22.430099 19622 consensus_queue.cc:1035] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:22.447937 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:22.432618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:45469 (local address 127.11.49.65:36491)
0924 12:53:22.433015 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:22.433023 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:22.438640 (+ 5617us) server_negotiation.cc:407] Connection header received
0924 12:53:22.438946 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:22.438952 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:22.439059 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:22.439145 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:53:22.439933 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.441214 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.445218 (+ 4004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.446127 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.446315 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:22.446899 (+ 584us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:53:22.447073 (+ 174us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:53:22.447183 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:22.447379 (+ 196us) server_negotiation.cc:299] Negotiation successful
0924 12:53:22.447502 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260924 12:53:22.447969 19628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:22.432413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36491 (local address 127.11.49.65:45469)
0924 12:53:22.438526 (+ 6113us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:22.438553 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:22.438759 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:22.439344 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:22.439350 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:22.439362 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 12:53:22.439737 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:22.439755 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.441583 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.441589 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:22.445011 (+ 3422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:22.445031 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.446341 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.446347 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:22.446606 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:22.446675 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 12:53:22.447211 (+ 536us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 12:53:22.447222 (+ 11us) client_negotiation.cc:769] Sending connection context
0924 12:53:22.447323 (+ 101us) client_negotiation.cc:240] Negotiation successful
0924 12:53:22.447440 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5880,"thread_start_us":5698,"threads_started":1}
I20260924 12:53:22.528693 19050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:22.529122 19050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:22.533120 19050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15: Sending DeleteTablet for 3 replicas of tablet 8f71855d2de748ee97a9096b88f9414f
I20260924 12:53:22.534246 19188 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f71855d2de748ee97a9096b88f9414f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:22 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:37660
I20260924 12:53:22.534463 19328 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f71855d2de748ee97a9096b88f9414f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:22 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:35652
I20260924 12:53:22.535090 19473 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f71855d2de748ee97a9096b88f9414f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:22 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:47098
I20260924 12:53:22.546983 19631 tablet_replica.cc:330] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56: stopping tablet replica
I20260924 12:53:22.547520 19631 raft_consensus.cc:2229] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:53:22.548451 19631 raft_consensus.cc:2258] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:22.550133 19631 ts_tablet_manager.cc:1905] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:22.551110 19632 tablet_replica.cc:330] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544: stopping tablet replica
I20260924 12:53:22.551344 19632 raft_consensus.cc:2229] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:22.551590 19632 raft_consensus.cc:2258] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:22.552841 19632 ts_tablet_manager.cc:1905] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:22.559188 19631 ts_tablet_manager.cc:1918] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:53:22.559429 19631 log.cc:1196] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/8f71855d2de748ee97a9096b88f9414f
I20260924 12:53:22.559942 19631 ts_tablet_manager.cc:1939] T 8f71855d2de748ee97a9096b88f9414f P ffb91fadb1074e7e98ec460f058e3c56: Deleting consensus metadata
I20260924 12:53:22.560420 19632 ts_tablet_manager.cc:1918] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:53:22.560559 19632 log.cc:1196] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/8f71855d2de748ee97a9096b88f9414f
I20260924 12:53:22.560956 19632 ts_tablet_manager.cc:1939] T 8f71855d2de748ee97a9096b88f9414f P 0aa41e5dca4549f0ac13b05276d4a544: Deleting consensus metadata
I20260924 12:53:22.561748 19037 catalog_manager.cc:4841] TS ffb91fadb1074e7e98ec460f058e3c56 (127.11.49.65:36491): tablet 8f71855d2de748ee97a9096b88f9414f (table test-table [id=c86f2bdf8fc24a4db06b21d20b95d30b]) successfully deleted
I20260924 12:53:22.562266 19038 catalog_manager.cc:4841] TS 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421): tablet 8f71855d2de748ee97a9096b88f9414f (table test-table [id=c86f2bdf8fc24a4db06b21d20b95d30b]) successfully deleted
I20260924 12:53:22.563750 19633 tablet_replica.cc:330] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627: stopping tablet replica
I20260924 12:53:22.563987 19633 raft_consensus.cc:2229] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:22.564257 19633 raft_consensus.cc:2258] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:22.565264 19633 ts_tablet_manager.cc:1905] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:22.570569 19633 ts_tablet_manager.cc:1918] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:53:22.570736 19633 log.cc:1196] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/8f71855d2de748ee97a9096b88f9414f
I20260924 12:53:22.571107 19633 ts_tablet_manager.cc:1939] T 8f71855d2de748ee97a9096b88f9414f P 9ac740bcbb804b65bcad690e24133627: Deleting consensus metadata
I20260924 12:53:22.572129 19038 catalog_manager.cc:4841] TS 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503): tablet 8f71855d2de748ee97a9096b88f9414f (table test-table [id=c86f2bdf8fc24a4db06b21d20b95d30b]) successfully deleted
Sep 24 12:53:22 dist-test-slave-m9hg krb5kdc[19007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 24 12:53:22 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:22 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
W20260924 12:53:22.631551 19641 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:22.616394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55872 (local address 127.11.49.126:39873)
0924 12:53:22.617246 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:22.617251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:22.617269 (+ 18us) server_negotiation.cc:407] Connection header received
0924 12:53:22.617357 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:22.617362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:22.617447 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:22.617577 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:22.619885 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.620959 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.623061 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.623496 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.623616 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:22.631242 (+ 7626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55872: BlockingRecv error: recv got EOF from 127.0.0.1:55872 (error 108)
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":484,"threads_started":1}
Sep 24 12:53:22 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM
I20260924 12:53:22.657483 19641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:22.635867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55882 (local address 127.11.49.126:39873)
0924 12:53:22.636182 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:22.636192 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:22.636816 (+ 624us) server_negotiation.cc:407] Connection header received
0924 12:53:22.637139 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:22.637144 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:22.637242 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:22.637355 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:22.639511 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.640349 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.642478 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.642992 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.643131 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:22.649135 (+ 6004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:22.649147 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:22.649153 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:22.649226 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:22.653448 (+ 4222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:22.654415 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:22.654425 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:22.654431 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:22.654666 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:22.655181 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:22.655186 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:22.655189 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:22.655664 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:22.656025 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:22.656588 (+ 563us) server_negotiation.cc:299] Negotiation successful
0924 12:53:22.656921 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260924 12:53:22.662813 19050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:53:22.663693 19050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:53:22.672051 19188 tablet_service.cc:1467] Processing CreateTablet for tablet 27bd377dff33427395e38a04962ecd18 (DEFAULT_TABLE table=test-table [id=8a253ba1c4d748e98813da6cf714fbb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:22.672811 19188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27bd377dff33427395e38a04962ecd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:22.672688 19328 tablet_service.cc:1467] Processing CreateTablet for tablet 27bd377dff33427395e38a04962ecd18 (DEFAULT_TABLE table=test-table [id=8a253ba1c4d748e98813da6cf714fbb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:22.673292 19328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27bd377dff33427395e38a04962ecd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:22.676992 19473 tablet_service.cc:1467] Processing CreateTablet for tablet 27bd377dff33427395e38a04962ecd18 (DEFAULT_TABLE table=test-table [id=8a253ba1c4d748e98813da6cf714fbb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:22.677531 19473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27bd377dff33427395e38a04962ecd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:22.685289 19648 tablet_bootstrap.cc:492] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544: Bootstrap starting.
I20260924 12:53:22.687825 19647 tablet_bootstrap.cc:492] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56: Bootstrap starting.
I20260924 12:53:22.688378 19648 tablet_bootstrap.cc:654] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:22.690647 19647 tablet_bootstrap.cc:654] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:22.695592 19648 tablet_bootstrap.cc:492] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544: No bootstrap required, opened a new log
I20260924 12:53:22.695966 19647 tablet_bootstrap.cc:492] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56: No bootstrap required, opened a new log
I20260924 12:53:22.695990 19648 ts_tablet_manager.cc:1397] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.008s
I20260924 12:53:22.696233 19647 ts_tablet_manager.cc:1397] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260924 12:53:22.697227 19648 raft_consensus.cc:348] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.697654 19649 tablet_bootstrap.cc:492] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627: Bootstrap starting.
I20260924 12:53:22.697540 19647 raft_consensus.cc:348] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.697784 19648 raft_consensus.cc:374] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:22.697850 19647 raft_consensus.cc:374] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:22.697974 19647 raft_consensus.cc:729] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb91fadb1074e7e98ec460f058e3c56, State: Initialized, Role: FOLLOWER
I20260924 12:53:22.698024 19648 raft_consensus.cc:729] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa41e5dca4549f0ac13b05276d4a544, State: Initialized, Role: FOLLOWER
I20260924 12:53:22.698278 19647 consensus_queue.cc:260] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.699062 19647 ts_tablet_manager.cc:1428] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260924 12:53:22.699776 19649 tablet_bootstrap.cc:654] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:22.703032 19649 tablet_bootstrap.cc:492] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627: No bootstrap required, opened a new log
I20260924 12:53:22.703222 19649 ts_tablet_manager.cc:1397] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260924 12:53:22.703744 19648 consensus_queue.cc:260] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.704092 19649 raft_consensus.cc:348] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.704412 19649 raft_consensus.cc:374] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:22.704509 19649 raft_consensus.cc:729] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac740bcbb804b65bcad690e24133627, State: Initialized, Role: FOLLOWER
I20260924 12:53:22.704756 19649 consensus_queue.cc:260] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.706288 19649 ts_tablet_manager.cc:1428] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 12:53:22.709612 19648 ts_tablet_manager.cc:1428] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260924 12:53:22.735944 19570 raft_consensus.cc:482] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:53:22.736253 19570 raft_consensus.cc:504] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.737250 19570 leader_election.cc:288] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421), 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503)
I20260924 12:53:22.737869 19353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27bd377dff33427395e38a04962ecd18" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa41e5dca4549f0ac13b05276d4a544" is_pre_election: true
I20260924 12:53:22.738058 19494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27bd377dff33427395e38a04962ecd18" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac740bcbb804b65bcad690e24133627" is_pre_election: true
I20260924 12:53:22.738180 19353 raft_consensus.cc:2454] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 0.
I20260924 12:53:22.738463 19494 raft_consensus.cc:2454] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 0.
I20260924 12:53:22.738755 19141 leader_election.cc:302] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa41e5dca4549f0ac13b05276d4a544, ffb91fadb1074e7e98ec460f058e3c56; no voters:
I20260924 12:53:22.739212 19570 raft_consensus.cc:2781] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:53:22.739379 19570 raft_consensus.cc:482] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:53:22.739507 19570 raft_consensus.cc:3037] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:22.743345 19570 raft_consensus.cc:504] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.744345 19570 leader_election.cc:288] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421), 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503)
I20260924 12:53:22.745072 19353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27bd377dff33427395e38a04962ecd18" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa41e5dca4549f0ac13b05276d4a544"
I20260924 12:53:22.745409 19353 raft_consensus.cc:3037] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:22.745306 19494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27bd377dff33427395e38a04962ecd18" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac740bcbb804b65bcad690e24133627"
I20260924 12:53:22.745676 19494 raft_consensus.cc:3037] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:22.748159 19353 raft_consensus.cc:2454] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 1.
I20260924 12:53:22.748752 19141 leader_election.cc:302] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa41e5dca4549f0ac13b05276d4a544, ffb91fadb1074e7e98ec460f058e3c56; no voters:
I20260924 12:53:22.749120 19570 raft_consensus.cc:2781] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:22.749272 19494 raft_consensus.cc:2454] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 1.
I20260924 12:53:22.749347 19570 raft_consensus.cc:686] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 LEADER]: Becoming Leader. State: Replica: ffb91fadb1074e7e98ec460f058e3c56, State: Running, Role: LEADER
I20260924 12:53:22.749686 19570 consensus_queue.cc:237] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.753141 19052 catalog_manager.cc:5495] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffb91fadb1074e7e98ec460f058e3c56 (127.11.49.65). New cstate: current_term: 1 leader_uuid: "ffb91fadb1074e7e98ec460f058e3c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } health_report { overall_health: UNKNOWN } } }
I20260924 12:53:22.791924 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:22.783032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37694 (local address 127.11.49.65:36491)
0924 12:53:22.783334 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:22.783341 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:22.783364 (+ 23us) server_negotiation.cc:407] Connection header received
0924 12:53:22.783436 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:22.783442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:22.783529 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:22.783643 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:53:22.784402 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.786012 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.788647 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:22.789601 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:22.789809 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:22.790523 (+ 714us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:53:22.790748 (+ 225us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:53:22.790874 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:22.791327 (+ 453us) server_negotiation.cc:299] Negotiation successful
0924 12:53:22.791455 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260924 12:53:22.795746 19353 raft_consensus.cc:1261] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Refusing update from remote peer ffb91fadb1074e7e98ec460f058e3c56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:22.795859 19494 raft_consensus.cc:1261] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Refusing update from remote peer ffb91fadb1074e7e98ec460f058e3c56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:22.797133 19621 consensus_queue.cc:1035] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260924 12:53:22.798363 19570 consensus_queue.cc:1035] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:22.827452 19052 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:22.827829 19052 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:22.831326 19052 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15: Sending DeleteTablet for 3 replicas of tablet 27bd377dff33427395e38a04962ecd18
I20260924 12:53:22.832556 19473 tablet_service.cc:1514] Processing DeleteTablet for tablet 27bd377dff33427395e38a04962ecd18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:22 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:47098
I20260924 12:53:22.832525 19328 tablet_service.cc:1514] Processing DeleteTablet for tablet 27bd377dff33427395e38a04962ecd18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:22 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:35652
I20260924 12:53:22.832603 19188 tablet_service.cc:1514] Processing DeleteTablet for tablet 27bd377dff33427395e38a04962ecd18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:22 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:37660
I20260924 12:53:22.832891 19633 tablet_replica.cc:330] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627: stopping tablet replica
I20260924 12:53:22.833015 19631 tablet_replica.cc:330] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56: stopping tablet replica
I20260924 12:53:22.833019 19632 tablet_replica.cc:330] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544: stopping tablet replica
I20260924 12:53:22.833137 19633 raft_consensus.cc:2229] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:22.833242 19631 raft_consensus.cc:2229] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:53:22.833267 19632 raft_consensus.cc:2229] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:22.833413 19633 raft_consensus.cc:2258] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:22.833498 19632 raft_consensus.cc:2258] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:22.833642 19631 raft_consensus.cc:2258] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:22.834779 19632 ts_tablet_manager.cc:1905] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:22.835203 19631 ts_tablet_manager.cc:1905] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:22.836022 19633 ts_tablet_manager.cc:1905] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:22.842530 19632 ts_tablet_manager.cc:1918] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:22.843020 19632 log.cc:1196] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/27bd377dff33427395e38a04962ecd18
I20260924 12:53:22.843382 19633 ts_tablet_manager.cc:1918] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:22.843559 19633 log.cc:1196] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/27bd377dff33427395e38a04962ecd18
I20260924 12:53:22.843796 19631 ts_tablet_manager.cc:1918] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:22.843858 19632 ts_tablet_manager.cc:1939] T 27bd377dff33427395e38a04962ecd18 P 0aa41e5dca4549f0ac13b05276d4a544: Deleting consensus metadata
I20260924 12:53:22.844035 19631 log.cc:1196] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/27bd377dff33427395e38a04962ecd18
I20260924 12:53:22.844389 19633 ts_tablet_manager.cc:1939] T 27bd377dff33427395e38a04962ecd18 P 9ac740bcbb804b65bcad690e24133627: Deleting consensus metadata
I20260924 12:53:22.844568 19631 ts_tablet_manager.cc:1939] T 27bd377dff33427395e38a04962ecd18 P ffb91fadb1074e7e98ec460f058e3c56: Deleting consensus metadata
I20260924 12:53:22.845638 19038 catalog_manager.cc:4841] TS 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503): tablet 27bd377dff33427395e38a04962ecd18 (table test-table [id=8a253ba1c4d748e98813da6cf714fbb0]) successfully deleted
I20260924 12:53:22.846076 19037 catalog_manager.cc:4841] TS ffb91fadb1074e7e98ec460f058e3c56 (127.11.49.65:36491): tablet 27bd377dff33427395e38a04962ecd18 (table test-table [id=8a253ba1c4d748e98813da6cf714fbb0]) successfully deleted
I20260924 12:53:22.846244 19038 catalog_manager.cc:4841] TS 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421): tablet 27bd377dff33427395e38a04962ecd18 (table test-table [id=8a253ba1c4d748e98813da6cf714fbb0]) successfully deleted
I20260924 12:53:22.846704 19052 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:53:22.847536 19052 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:53:22.856644 19328 tablet_service.cc:1467] Processing CreateTablet for tablet 5a53fef19b524b11b6111b18115c743a (DEFAULT_TABLE table=test-table [id=1118bf914baf41d9b81e4369ffc28bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:22.856768 19188 tablet_service.cc:1467] Processing CreateTablet for tablet 5a53fef19b524b11b6111b18115c743a (DEFAULT_TABLE table=test-table [id=1118bf914baf41d9b81e4369ffc28bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:22.857232 19328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a53fef19b524b11b6111b18115c743a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:22.857386 19188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a53fef19b524b11b6111b18115c743a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:22.862296 19648 tablet_bootstrap.cc:492] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544: Bootstrap starting.
I20260924 12:53:22.863966 19473 tablet_service.cc:1467] Processing CreateTablet for tablet 5a53fef19b524b11b6111b18115c743a (DEFAULT_TABLE table=test-table [id=1118bf914baf41d9b81e4369ffc28bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:22.864142 19648 tablet_bootstrap.cc:654] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:22.864444 19473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a53fef19b524b11b6111b18115c743a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:22.865787 19647 tablet_bootstrap.cc:492] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56: Bootstrap starting.
I20260924 12:53:22.868258 19647 tablet_bootstrap.cc:654] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:22.875205 19648 tablet_bootstrap.cc:492] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544: No bootstrap required, opened a new log
I20260924 12:53:22.875815 19649 tablet_bootstrap.cc:492] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627: Bootstrap starting.
I20260924 12:53:22.877609 19649 tablet_bootstrap.cc:654] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:22.875576 19648 ts_tablet_manager.cc:1397] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.007s
I20260924 12:53:22.879746 19648 raft_consensus.cc:348] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.880141 19648 raft_consensus.cc:374] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:22.880326 19648 raft_consensus.cc:729] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa41e5dca4549f0ac13b05276d4a544, State: Initialized, Role: FOLLOWER
I20260924 12:53:22.880708 19647 tablet_bootstrap.cc:492] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56: No bootstrap required, opened a new log
I20260924 12:53:22.880949 19647 ts_tablet_manager.cc:1397] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20260924 12:53:22.880856 19648 consensus_queue.cc:260] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.881471 19649 tablet_bootstrap.cc:492] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627: No bootstrap required, opened a new log
I20260924 12:53:22.881652 19649 ts_tablet_manager.cc:1397] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260924 12:53:22.881989 19647 raft_consensus.cc:348] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.882290 19647 raft_consensus.cc:374] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:22.882432 19647 raft_consensus.cc:729] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb91fadb1074e7e98ec460f058e3c56, State: Initialized, Role: FOLLOWER
I20260924 12:53:22.882637 19649 raft_consensus.cc:348] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.882735 19647 consensus_queue.cc:260] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.884217 19648 ts_tablet_manager.cc:1428] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260924 12:53:22.882927 19649 raft_consensus.cc:374] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:22.884445 19649 raft_consensus.cc:729] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac740bcbb804b65bcad690e24133627, State: Initialized, Role: FOLLOWER
I20260924 12:53:22.884811 19649 consensus_queue.cc:260] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:22.886569 19649 ts_tablet_manager.cc:1428] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260924 12:53:22.887475 19647 ts_tablet_manager.cc:1428] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260924 12:53:23.107345 19622 raft_consensus.cc:482] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:53:23.107599 19622 raft_consensus.cc:504] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:23.108381 19622 leader_election.cc:288] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421), 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503)
I20260924 12:53:23.109052 19353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a53fef19b524b11b6111b18115c743a" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa41e5dca4549f0ac13b05276d4a544" is_pre_election: true
I20260924 12:53:23.109318 19493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a53fef19b524b11b6111b18115c743a" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac740bcbb804b65bcad690e24133627" is_pre_election: true
I20260924 12:53:23.109634 19353 raft_consensus.cc:2454] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 0.
I20260924 12:53:23.109706 19493 raft_consensus.cc:2454] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 0.
I20260924 12:53:23.110472 19141 leader_election.cc:302] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa41e5dca4549f0ac13b05276d4a544, ffb91fadb1074e7e98ec460f058e3c56; no voters:
I20260924 12:53:23.110869 19622 raft_consensus.cc:2781] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:53:23.111027 19622 raft_consensus.cc:482] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:53:23.111116 19622 raft_consensus.cc:3037] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:23.114454 19622 raft_consensus.cc:504] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:23.115165 19622 leader_election.cc:288] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421), 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503)
I20260924 12:53:23.115949 19353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a53fef19b524b11b6111b18115c743a" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa41e5dca4549f0ac13b05276d4a544"
I20260924 12:53:23.116083 19493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a53fef19b524b11b6111b18115c743a" candidate_uuid: "ffb91fadb1074e7e98ec460f058e3c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac740bcbb804b65bcad690e24133627"
I20260924 12:53:23.116258 19353 raft_consensus.cc:3037] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:23.116442 19493 raft_consensus.cc:3037] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:23.120522 19493 raft_consensus.cc:2454] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 1.
I20260924 12:53:23.121155 19353 raft_consensus.cc:2454] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb91fadb1074e7e98ec460f058e3c56 in term 1.
I20260924 12:53:23.121460 19141 leader_election.cc:302] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac740bcbb804b65bcad690e24133627, ffb91fadb1074e7e98ec460f058e3c56; no voters:
I20260924 12:53:23.122241 19622 raft_consensus.cc:2781] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:23.122605 19622 raft_consensus.cc:686] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 1 LEADER]: Becoming Leader. State: Replica: ffb91fadb1074e7e98ec460f058e3c56, State: Running, Role: LEADER
I20260924 12:53:23.123064 19622 consensus_queue.cc:237] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } }
I20260924 12:53:23.127287 19051 catalog_manager.cc:5495] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffb91fadb1074e7e98ec460f058e3c56 (127.11.49.65). New cstate: current_term: 1 leader_uuid: "ffb91fadb1074e7e98ec460f058e3c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb91fadb1074e7e98ec460f058e3c56" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 } health_report { overall_health: UNKNOWN } } }
I20260924 12:53:23.207186 19353 raft_consensus.cc:1261] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Refusing update from remote peer ffb91fadb1074e7e98ec460f058e3c56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:23.207146 19493 raft_consensus.cc:1261] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Refusing update from remote peer ffb91fadb1074e7e98ec460f058e3c56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:23.207890 19621 consensus_queue.cc:1035] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac740bcbb804b65bcad690e24133627" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 45503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:23.208251 19622 consensus_queue.cc:1035] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa41e5dca4549f0ac13b05276d4a544" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:23.215497 19615 mvcc.cc:205] Tried to move back new op lower bound from 7332882035530756096 to 7332882035196043264. Current Snapshot: MvccSnapshot[applied={T|T < 7332882035530756096}]
I20260924 12:53:23.276494 19051 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:23.276827 19051 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:23.280331 19051 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ad8c488b3ac491ea94cbcc739de1e15: Sending DeleteTablet for 3 replicas of tablet 5a53fef19b524b11b6111b18115c743a
I20260924 12:53:23.281607 19473 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a53fef19b524b11b6111b18115c743a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:23 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:47098
I20260924 12:53:23.281769 19328 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a53fef19b524b11b6111b18115c743a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:23 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:35652
I20260924 12:53:23.281982 19633 tablet_replica.cc:330] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627: stopping tablet replica
I20260924 12:53:23.282171 19633 raft_consensus.cc:2229] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:23.282194 19632 tablet_replica.cc:330] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544: stopping tablet replica
I20260924 12:53:23.282390 19633 raft_consensus.cc:2258] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:23.282397 19632 raft_consensus.cc:2229] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:23.282655 19632 raft_consensus.cc:2258] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:23.282763 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 19123
I20260924 12:53:23.283680 19188 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a53fef19b524b11b6111b18115c743a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:23 UTC) from {username='oryx', principal='oryx/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:37660
I20260924 12:53:23.284102 19631 tablet_replica.cc:330] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56: stopping tablet replica
I20260924 12:53:23.284372 19631 raft_consensus.cc:2229] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:53:23.284853 19631 raft_consensus.cc:2258] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:23.286592 19633 ts_tablet_manager.cc:1905] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:23.286974 19632 ts_tablet_manager.cc:1905] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:23.293767 19631 ts_tablet_manager.cc:1905] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:23.294277 19633 ts_tablet_manager.cc:1918] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:53:23.294426 19633 log.cc:1196] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/5a53fef19b524b11b6111b18115c743a
I20260924 12:53:23.294924 19633 ts_tablet_manager.cc:1939] T 5a53fef19b524b11b6111b18115c743a P 9ac740bcbb804b65bcad690e24133627: Deleting consensus metadata
I20260924 12:53:23.296205 19038 catalog_manager.cc:4841] TS 9ac740bcbb804b65bcad690e24133627 (127.11.49.67:45503): tablet 5a53fef19b524b11b6111b18115c743a (table test-table [id=1118bf914baf41d9b81e4369ffc28bcf]) successfully deleted
Sep 24 12:53:23 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.49.65@KRBTEST.COM
I20260924 12:53:23.299144 19632 ts_tablet_manager.cc:1918] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:53:23.299327 19632 log.cc:1196] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/5a53fef19b524b11b6111b18115c743a
I20260924 12:53:23.300856 19632 ts_tablet_manager.cc:1939] T 5a53fef19b524b11b6111b18115c743a P 0aa41e5dca4549f0ac13b05276d4a544: Deleting consensus metadata
I20260924 12:53:23.302250 19038 catalog_manager.cc:4841] TS 0aa41e5dca4549f0ac13b05276d4a544 (127.11.49.66:46421): tablet 5a53fef19b524b11b6111b18115c743a (table test-table [id=1118bf914baf41d9b81e4369ffc28bcf]) successfully deleted
I20260924 12:53:23.304198 19631 ts_tablet_manager.cc:1918] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 12:53:23.304476 19631 log.cc:1196] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/5a53fef19b524b11b6111b18115c743a
I20260924 12:53:23.305040 19631 ts_tablet_manager.cc:1939] T 5a53fef19b524b11b6111b18115c743a P ffb91fadb1074e7e98ec460f058e3c56: Deleting consensus metadata
I20260924 12:53:23.306607 19037 catalog_manager.cc:4841] TS ffb91fadb1074e7e98ec460f058e3c56 (127.11.49.65:36491): tablet 5a53fef19b524b11b6111b18115c743a (table test-table [id=1118bf914baf41d9b81e4369ffc28bcf]) successfully deleted
I20260924 12:53:23.308398 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:23.285417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37702 (local address 127.11.49.65:36491)
0924 12:53:23.285643 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:23.285651 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:23.285851 (+ 200us) server_negotiation.cc:407] Connection header received
0924 12:53:23.286149 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:23.286155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:23.286269 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:23.286372 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:23.288226 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:23.289442 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:23.291219 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:23.291972 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:23.292089 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:23.300454 (+ 8365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:23.300480 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:23.300507 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:23.300581 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:23.304841 (+ 4260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:23.305660 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:23.305673 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:23.305677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:23.305826 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:23.306239 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:23.306244 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:23.306247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:23.306774 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:23.307125 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:23.307369 (+ 244us) server_negotiation.cc:299] Negotiation successful
0924 12:53:23.307586 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260924 12:53:23.309322 19254 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:23.478096 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 19123
I20260924 12:53:23.508972 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 19263
Sep 24 12:53:23 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.49.66@KRBTEST.COM
I20260924 12:53:23.527094 19667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:23.509939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35654 (local address 127.11.49.66:46421)
0924 12:53:23.510535 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:23.510540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:23.510563 (+ 23us) server_negotiation.cc:407] Connection header received
0924 12:53:23.510634 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:23.510638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:23.510707 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:23.510836 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:23.512233 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:23.513138 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:23.514596 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:23.515083 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:23.515194 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:23.520243 (+ 5049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:23.520308 (+ 65us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:23.520334 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:23.520373 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:23.523269 (+ 2896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:23.524757 (+ 1488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:23.524765 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:23.524767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:23.524930 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:23.525393 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:23.525396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:23.525398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:23.525749 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:23.525976 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:23.526531 (+ 555us) server_negotiation.cc:299] Negotiation successful
0924 12:53:23.526807 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":386,"threads_started":1}
I20260924 12:53:23.527962 19394 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:23.632081 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 19263
I20260924 12:53:23.652172 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 19403
Sep 24 12:53:23 dist-test-slave-m9hg krb5kdc[19007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.49.67@KRBTEST.COM
I20260924 12:53:23.671844 19669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:23.653232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47106 (local address 127.11.49.67:45503)
0924 12:53:23.653834 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:23.653840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:23.653863 (+ 23us) server_negotiation.cc:407] Connection header received
0924 12:53:23.653937 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:23.653942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:23.654083 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:23.654216 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:23.655719 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:23.656818 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:23.658441 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:23.658929 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:23.659063 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:23.664259 (+ 5196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:23.664489 (+ 230us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:23.664512 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:23.664598 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:23.668244 (+ 3646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:23.669390 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:23.669399 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:23.669402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:23.669609 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:23.670138 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:23.670141 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:23.670144 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:23.670575 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:23.670851 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:23.671320 (+ 469us) server_negotiation.cc:299] Negotiation successful
0924 12:53:23.671557 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":354,"threads_started":1}
I20260924 12:53:23.672735 19534 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:23.821094 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 19403
I20260924 12:53:23.847791 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 19020
I20260924 12:53:23.849133 19092 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:23.970327 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 19020
2026-09-24T12:53:23Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7974 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:53:24 dist-test-slave-m9hg krb5kdc[19674](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:53:24 dist-test-slave-m9hg krb5kdc[19674](info): set up 2 sockets
Sep 24 12:53:24 dist-test-slave-m9hg krb5kdc[19674](info): commencing operation
krb5kdc: starting...
W20260924 12:53:25.114403 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:53:25 dist-test-slave-m9hg krb5kdc[19674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:53:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:53:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:53:25.397667 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:37183
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:39263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:37183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:25.782718 19687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:25.783244 19687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:25.783448 19687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:25.792510 19687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:53:25.792758 19687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:25.792883 19687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:25.793051 19687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:53:25.793150 19687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:53:25.806636 19687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:37183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:37183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:25.808643 19687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:25.810770 19687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:25.828413 19692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:25.828456 19695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:25.828466 19693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:25.829695 19687 server_base.cc:1034] running on GCE node
I20260924 12:53:25.830835 19687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:25.832625 19687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:25.833956 19687 hybrid_clock.cc:648] HybridClock initialized: now 1790254405833869 us; error 91 us; skew 500 ppm
I20260924 12:53:25.834419 19687 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-24T12:53:25Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1961 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:53:26 dist-test-slave-m9hg krb5kdc[19701](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:53:26 dist-test-slave-m9hg krb5kdc[19701](info): set up 2 sockets
Sep 24 12:53:26 dist-test-slave-m9hg krb5kdc[19701](info): commencing operation
krb5kdc: starting...
W20260924 12:53:27.102125 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.002s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:53:27 dist-test-slave-m9hg krb5kdc[19701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:53:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:53:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:53:27.376853 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:46457
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:46457
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:27.718189 19714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:27.718534 19714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:27.718628 19714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:27.726315 19714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:53:27.726452 19714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:27.726500 19714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:27.726588 19714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:53:27.726670 19714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:53:27.737202 19714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:46457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:46457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:27.738662 19714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:27.740012 19714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:27.754315 19719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:27.754560 19722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:27.754627 19720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:27.756145 19714 server_base.cc:1034] running on GCE node
I20260924 12:53:27.757349 19714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:27.759533 19714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:27.760851 19714 hybrid_clock.cc:648] HybridClock initialized: now 1790254407760763 us; error 80 us; skew 500 ppm
I20260924 12:53:27.761412 19714 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:27 dist-test-slave-m9hg krb5kdc[19701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254407, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:27.771348 19714 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:53:27.773830 19714 webserver.cc:460] Webserver started at http://127.11.49.126:34235/ using document root <none> and password file <none>
I20260924 12:53:27.775120 19714 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:27.775369 19714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:27.775821 19714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:27.779898 19714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "01ca8cc735304b71a254301b2e1bae98"
format_stamp: "Formatted at 2026-09-24 12:53:27 on dist-test-slave-m9hg"
server_key: "6ba388acf3bdaecbe0585b8a1dcaf021"
server_key_iv: "a88bbd3b6b4e48cb874e0148c9291ecf"
server_key_version: "encryptionkey@0"
I20260924 12:53:27.781069 19714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "01ca8cc735304b71a254301b2e1bae98"
format_stamp: "Formatted at 2026-09-24 12:53:27 on dist-test-slave-m9hg"
server_key: "6ba388acf3bdaecbe0585b8a1dcaf021"
server_key_iv: "a88bbd3b6b4e48cb874e0148c9291ecf"
server_key_version: "encryptionkey@0"
I20260924 12:53:27.788441 19714 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.004s
I20260924 12:53:27.793699 19729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:27.795855 19714 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.003s
I20260924 12:53:27.796171 19714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "01ca8cc735304b71a254301b2e1bae98"
format_stamp: "Formatted at 2026-09-24 12:53:27 on dist-test-slave-m9hg"
server_key: "6ba388acf3bdaecbe0585b8a1dcaf021"
server_key_iv: "a88bbd3b6b4e48cb874e0148c9291ecf"
server_key_version: "encryptionkey@0"
I20260924 12:53:27.796548 19714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:27.825467 19714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:27.831189 19714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:27.831593 19714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:27.855579 19714 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:46457
I20260924 12:53:27.855573 19780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:46457 every 8 connection(s)
I20260924 12:53:27.857616 19714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:53:27.861819 19781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:27.862637 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 19714
I20260924 12:53:27.862885 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:53:27.863777 11461 external_mini_cluster.cc:1428] Setting key 4189a286d99784e1ca7271a037e0da0b
I20260924 12:53:27.876183 19781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98: Bootstrap starting.
I20260924 12:53:27.880089 19781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:27.881574 19781 log.cc:824] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98: Log is configured to *not* fsync() on all Append() calls
Sep 24 12:53:27 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:27.885442 19781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98: No bootstrap required, opened a new log
I20260924 12:53:27.893914 19781 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } }
I20260924 12:53:27.894402 19781 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:27.894534 19781 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01ca8cc735304b71a254301b2e1bae98, State: Initialized, Role: FOLLOWER
I20260924 12:53:27.895334 19784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:27.866831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44244 (local address 127.11.49.126:46457)
0924 12:53:27.868487 (+ 1656us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:27.868508 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:27.868575 (+ 67us) server_negotiation.cc:407] Connection header received
0924 12:53:27.870772 (+ 2197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:27.870808 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:27.871436 (+ 628us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:27.871932 (+ 496us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:27.874108 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:27.875890 (+ 1782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:27.877918 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:27.879298 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:27.879521 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:27.885088 (+ 5567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:27.885101 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:27.885125 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:27.885182 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:27.889378 (+ 4196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:27.890520 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:27.890531 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:27.890541 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:27.890798 (+ 257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:27.891277 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:27.891282 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:27.891284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:27.892104 (+ 820us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:27.892565 (+ 461us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:27.893067 (+ 502us) server_negotiation.cc:299] Negotiation successful
0924 12:53:27.893680 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1249,"thread_start_us":900,"threads_started":1}
I20260924 12:53:27.895335 19781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } }
I20260924 12:53:27.895803 19781 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:53:27.895946 19781 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:53:27.896126 19781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:27.898877 19781 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } }
I20260924 12:53:27.899464 19781 leader_election.cc:302] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01ca8cc735304b71a254301b2e1bae98; no voters:
I20260924 12:53:27.900255 19781 leader_election.cc:288] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:53:27.900564 19786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:27.901543 19786 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 1 LEADER]: Becoming Leader. State: Replica: 01ca8cc735304b71a254301b2e1bae98, State: Running, Role: LEADER
I20260924 12:53:27.902370 19786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } }
I20260924 12:53:27.902810 19781 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:53:27.906370 19788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01ca8cc735304b71a254301b2e1bae98. Latest consensus state: current_term: 1 leader_uuid: "01ca8cc735304b71a254301b2e1bae98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } } }
I20260924 12:53:27.906948 19788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:27.906322 19787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01ca8cc735304b71a254301b2e1bae98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } } }
I20260924 12:53:27.907485 19787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:27.920210 19792 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:53:27.926497 19792 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:53:27.938998 19792 catalog_manager.cc:1347] Generated new cluster ID: 509df26a19414e61af7cae49523f036d
I20260924 12:53:27.939219 19792 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:53:27.950176 19792 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:53:27.951864 19792 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:53:27.960701 19792 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98: Generated new TSK 0
I20260924 12:53:27.962073 19792 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:53:28.041759 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46457
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:28.408700 19807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:28.409013 19807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:28.409113 19807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:28.416805 19807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:28.416937 19807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:28.417061 19807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:53:28.427628 19807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:28.429100 19807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:28.430608 19807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:28.445755 19812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:28.445832 19815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:28.446132 19813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:28.447249 19807 server_base.cc:1034] running on GCE node
I20260924 12:53:28.448009 19807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:28.449239 19807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:28.452768 19807 hybrid_clock.cc:648] HybridClock initialized: now 1790254408452648 us; error 65 us; skew 500 ppm
I20260924 12:53:28.453249 19807 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:28 dist-test-slave-m9hg krb5kdc[19701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254408, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:28.457154 19807 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:53:28.459110 19807 webserver.cc:460] Webserver started at http://127.11.49.65:33755/ using document root <none> and password file <none>
I20260924 12:53:28.459897 19807 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:28.460055 19807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:28.460469 19807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:28.463546 19807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "2c32b8e08689427a9f79f1e81e71faea"
format_stamp: "Formatted at 2026-09-24 12:53:28 on dist-test-slave-m9hg"
server_key: "a8b58821cffc66854253dd43fac311c6"
server_key_iv: "4449f0c926b9b3c0e281fbb0d2a2051b"
server_key_version: "encryptionkey@0"
I20260924 12:53:28.464490 19807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "2c32b8e08689427a9f79f1e81e71faea"
format_stamp: "Formatted at 2026-09-24 12:53:28 on dist-test-slave-m9hg"
server_key: "a8b58821cffc66854253dd43fac311c6"
server_key_iv: "4449f0c926b9b3c0e281fbb0d2a2051b"
server_key_version: "encryptionkey@0"
I20260924 12:53:28.470510 19807 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260924 12:53:28.475334 19822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:28.477445 19807 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260924 12:53:28.477715 19807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "2c32b8e08689427a9f79f1e81e71faea"
format_stamp: "Formatted at 2026-09-24 12:53:28 on dist-test-slave-m9hg"
server_key: "a8b58821cffc66854253dd43fac311c6"
server_key_iv: "4449f0c926b9b3c0e281fbb0d2a2051b"
server_key_version: "encryptionkey@0"
I20260924 12:53:28.477972 19807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:28.497792 19807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:28.503755 19807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:28.504134 19807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:28.505254 19807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:28.506804 19807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:28.506919 19807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:28.507098 19807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:28.507179 19807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:28.551864 19807 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:40841
I20260924 12:53:28.551898 19934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:40841 every 8 connection(s)
I20260924 12:53:28.553236 19807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:53:28.554385 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 19807
I20260924 12:53:28.554646 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:53:28.555533 11461 external_mini_cluster.cc:1428] Setting key 829fa20be5d64caf6879f769d0e93bec
Sep 24 12:53:28 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254408, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:28.579725 19937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:28.557467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:34119 (local address 127.11.49.126:46457)
0924 12:53:28.558079 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:28.558087 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:28.559765 (+ 1678us) server_negotiation.cc:407] Connection header received
0924 12:53:28.562081 (+ 2316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:28.562088 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:28.562201 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:28.562337 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:28.564123 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:28.565038 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:28.566797 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:28.567243 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:28.567410 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:28.571541 (+ 4131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:28.571555 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:28.571559 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:28.571595 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:28.574690 (+ 3095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:28.576231 (+ 1541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:28.576237 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:28.576240 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:28.576484 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:28.577261 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:28.577267 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:28.577269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:28.577629 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:28.577810 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:28.579131 (+ 1321us) server_negotiation.cc:299] Negotiation successful
0924 12:53:28.579348 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":285,"threads_started":1}
I20260924 12:53:28.581898 19938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:28.558343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:34119)
0924 12:53:28.559493 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:28.559545 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:28.561732 (+ 2187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:28.562636 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:28.562646 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:28.563272 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:28.563915 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:28.563934 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:28.565232 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:28.565236 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:28.566617 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:28.566630 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:28.567520 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:28.567527 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:28.567804 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:28.568688 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:28.568713 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:28.571263 (+ 2550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:28.575009 (+ 3746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:28.575026 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:28.575057 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:28.576000 (+ 943us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:28.576651 (+ 651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:28.576660 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:28.576667 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:28.577038 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:28.577861 (+ 823us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:28.577874 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:28.578590 (+ 716us) client_negotiation.cc:769] Sending connection context
0924 12:53:28.579010 (+ 420us) client_negotiation.cc:240] Negotiation successful
0924 12:53:28.579810 (+ 800us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":785,"thread_start_us":459,"threads_started":1}
I20260924 12:53:28.584578 19935 heartbeater.cc:347] Connected to a master server at 127.11.49.126:46457
I20260924 12:53:28.585103 19935 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:28.586505 19935 heartbeater.cc:511] Master 127.11.49.126:46457 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:53:28.589841 19746 ts_manager.cc:194] Registered new tserver with Master: 2c32b8e08689427a9f79f1e81e71faea (127.11.49.65:40841)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
I20260924 12:53:28.592494 19746 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:34119
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:53:28.624918 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46457
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:29.067611 19941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:29.068038 19941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:29.068152 19941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:29.077121 19941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:29.077312 19941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:29.077464 19941 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:53:29.089730 19941 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:29.091543 19941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:29.093405 19941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:29.110595 19947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:29.110641 19949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:29.110810 19946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:29.114333 19941 server_base.cc:1034] running on GCE node
I20260924 12:53:29.115394 19941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:29.117054 19941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:29.118338 19941 hybrid_clock.cc:648] HybridClock initialized: now 1790254409118272 us; error 55 us; skew 500 ppm
I20260924 12:53:29.118844 19941 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:29 dist-test-slave-m9hg krb5kdc[19701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:29.123245 19941 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:53:29.125977 19941 webserver.cc:460] Webserver started at http://127.11.49.66:39807/ using document root <none> and password file <none>
I20260924 12:53:29.127142 19941 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:29.127346 19941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:29.127751 19941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:29.131695 19941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "4a1f4b2aeaab4f3c8ec2db27cc2c7152"
format_stamp: "Formatted at 2026-09-24 12:53:29 on dist-test-slave-m9hg"
server_key: "1a0c19cfa59251ecc71f794f14f2d000"
server_key_iv: "3eb0f3e371a1e1489efb4234bfc242c9"
server_key_version: "encryptionkey@0"
I20260924 12:53:29.133018 19941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "4a1f4b2aeaab4f3c8ec2db27cc2c7152"
format_stamp: "Formatted at 2026-09-24 12:53:29 on dist-test-slave-m9hg"
server_key: "1a0c19cfa59251ecc71f794f14f2d000"
server_key_iv: "3eb0f3e371a1e1489efb4234bfc242c9"
server_key_version: "encryptionkey@0"
I20260924 12:53:29.140723 19941 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260924 12:53:29.145923 19956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:29.148383 19941 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.001s
I20260924 12:53:29.148695 19941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "4a1f4b2aeaab4f3c8ec2db27cc2c7152"
format_stamp: "Formatted at 2026-09-24 12:53:29 on dist-test-slave-m9hg"
server_key: "1a0c19cfa59251ecc71f794f14f2d000"
server_key_iv: "3eb0f3e371a1e1489efb4234bfc242c9"
server_key_version: "encryptionkey@0"
I20260924 12:53:29.149019 19941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:29.173053 19941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:29.179852 19941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:29.180374 19941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:29.181740 19941 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:29.183694 19941 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:29.183827 19941 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:29.184007 19941 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:29.184084 19941 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:29.227342 19941 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:41107
I20260924 12:53:29.227429 20068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:41107 every 8 connection(s)
I20260924 12:53:29.229199 19941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:53:29.236512 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 19941
I20260924 12:53:29.236748 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:53:29.237432 11461 external_mini_cluster.cc:1428] Setting key 302633e58fb87bc6ed3553653ed8fa2a
Sep 24 12:53:29 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:29.257089 20071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:29.232531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:42959 (local address 127.11.49.126:46457)
0924 12:53:29.233027 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:29.233032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:29.234436 (+ 1404us) server_negotiation.cc:407] Connection header received
0924 12:53:29.236651 (+ 2215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:29.236657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:29.236760 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:29.236910 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:29.239895 (+ 2985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:29.240889 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:29.242754 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:29.243206 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:29.243345 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:29.248381 (+ 5036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:29.248389 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:29.248393 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:29.248435 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:29.252575 (+ 4140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:29.253906 (+ 1331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:29.253916 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:29.253922 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:29.254106 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:29.254683 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:29.254691 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:29.254697 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:29.255092 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:29.255267 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:29.256257 (+ 990us) server_negotiation.cc:299] Negotiation successful
0924 12:53:29.256585 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":289,"threads_started":1}
I20260924 12:53:29.258276 20072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:29.233252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:42959)
0924 12:53:29.234229 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:29.234277 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:29.236343 (+ 2066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:29.237450 (+ 1107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:29.237470 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:29.238474 (+ 1004us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:29.239537 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:29.239576 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:29.241153 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:29.241158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:29.242562 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:29.242578 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:29.243479 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:29.243487 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:29.243738 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:29.244706 (+ 968us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:29.244736 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:29.247877 (+ 3141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:29.252917 (+ 5040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:29.252934 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:29.252956 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:29.253653 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:29.254257 (+ 604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:29.254261 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:29.254264 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:29.254545 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:29.255257 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:29.255268 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:29.255797 (+ 529us) client_negotiation.cc:769] Sending connection context
0924 12:53:29.256111 (+ 314us) client_negotiation.cc:240] Negotiation successful
0924 12:53:29.256751 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":400,"threads_started":1}
I20260924 12:53:29.260653 20069 heartbeater.cc:347] Connected to a master server at 127.11.49.126:46457
I20260924 12:53:29.261116 20069 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:29.262225 20069 heartbeater.cc:511] Master 127.11.49.126:46457 requested a full tablet report, sending...
I20260924 12:53:29.264642 19746 ts_manager.cc:194] Registered new tserver with Master: 4a1f4b2aeaab4f3c8ec2db27cc2c7152 (127.11.49.66:41107)
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
I20260924 12:53:29.265899 19746 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:42959
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:53:29.301033 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46457
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:53:29.597226 19935 heartbeater.cc:503] Master 127.11.49.126:46457 was elected leader, sending a full tablet report...
W20260924 12:53:29.746050 20075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:29.746456 20075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:29.746654 20075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:29.755566 20075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:29.755726 20075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:29.755959 20075 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:53:29.767650 20075 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:46457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:29.769657 20075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:29.771453 20075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:29.792686 20080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:29.792727 20081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:29.793859 20083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:29.795848 20075 server_base.cc:1034] running on GCE node
I20260924 12:53:29.796866 20075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:29.798359 20075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:29.799682 20075 hybrid_clock.cc:648] HybridClock initialized: now 1790254409799601 us; error 73 us; skew 500 ppm
I20260924 12:53:29.800207 20075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:29 dist-test-slave-m9hg krb5kdc[19701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:29.805459 20075 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:53:29.807785 20075 webserver.cc:460] Webserver started at http://127.11.49.67:36841/ using document root <none> and password file <none>
I20260924 12:53:29.808923 20075 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:29.809113 20075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:29.809525 20075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:29.813721 20075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "9743c037561e4aadbfafdf5c54c00ed0"
format_stamp: "Formatted at 2026-09-24 12:53:29 on dist-test-slave-m9hg"
server_key: "80f2539f36ef3c1fdd9bcbb99a1aaf02"
server_key_iv: "18d4f19275fa81e5657303e7ddb675a1"
server_key_version: "encryptionkey@0"
I20260924 12:53:29.814810 20075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "9743c037561e4aadbfafdf5c54c00ed0"
format_stamp: "Formatted at 2026-09-24 12:53:29 on dist-test-slave-m9hg"
server_key: "80f2539f36ef3c1fdd9bcbb99a1aaf02"
server_key_iv: "18d4f19275fa81e5657303e7ddb675a1"
server_key_version: "encryptionkey@0"
I20260924 12:53:29.822595 20075 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260924 12:53:29.827735 20090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:29.829818 20075 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260924 12:53:29.830112 20075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "9743c037561e4aadbfafdf5c54c00ed0"
format_stamp: "Formatted at 2026-09-24 12:53:29 on dist-test-slave-m9hg"
server_key: "80f2539f36ef3c1fdd9bcbb99a1aaf02"
server_key_iv: "18d4f19275fa81e5657303e7ddb675a1"
server_key_version: "encryptionkey@0"
I20260924 12:53:29.830420 20075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:29.865787 20075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:29.871632 20075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:29.872001 20075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:29.873384 20075 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:29.875219 20075 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:29.875308 20075 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:29.875512 20075 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:29.875597 20075 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:29.916232 20075 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:36697
I20260924 12:53:29.916381 20202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:36697 every 8 connection(s)
I20260924 12:53:29.917945 20075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:53:29.923080 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 20075
I20260924 12:53:29.923316 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:53:29.923979 11461 external_mini_cluster.cc:1428] Setting key aad879b51cc51635f7b1e193b0308528
Sep 24 12:53:29 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:29.944142 20205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:29.921405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:38573 (local address 127.11.49.126:46457)
0924 12:53:29.921955 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:29.921961 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:29.923332 (+ 1371us) server_negotiation.cc:407] Connection header received
0924 12:53:29.926011 (+ 2679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:29.926016 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:29.926119 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:29.926257 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:29.928738 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:29.929493 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:29.931744 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:29.932166 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:29.932353 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:29.937172 (+ 4819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:29.937177 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:29.937180 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:29.937229 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:29.940468 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:29.941620 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:29.941623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:29.941626 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:29.941756 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:29.942321 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:29.942324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:29.942326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:29.942582 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:29.942741 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:29.943670 (+ 929us) server_negotiation.cc:299] Negotiation successful
0924 12:53:29.943866 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":262,"threads_started":1}
I20260924 12:53:29.945623 20206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:29.922051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:38573)
0924 12:53:29.923073 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:29.923140 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:29.925569 (+ 2429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:29.926670 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:29.926682 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:29.927538 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:29.928520 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:29.928548 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:29.929724 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:29.929730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:29.931532 (+ 1802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:29.931550 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:29.932489 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:29.932496 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:29.932776 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:29.933659 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:29.933687 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:29.936843 (+ 3156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:29.940693 (+ 3850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:29.940709 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:29.940764 (+ 55us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:29.941443 (+ 679us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:29.941932 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:29.941936 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:29.941939 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:29.942203 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:29.942747 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:29.942755 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:29.943269 (+ 514us) client_negotiation.cc:769] Sending connection context
0924 12:53:29.943588 (+ 319us) client_negotiation.cc:240] Negotiation successful
0924 12:53:29.944142 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":368,"threads_started":1}
I20260924 12:53:29.947397 20203 heartbeater.cc:347] Connected to a master server at 127.11.49.126:46457
I20260924 12:53:29.947903 20203 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:29.948944 20203 heartbeater.cc:511] Master 127.11.49.126:46457 requested a full tablet report, sending...
I20260924 12:53:29.950882 19746 ts_manager.cc:194] Registered new tserver with Master: 9743c037561e4aadbfafdf5c54c00ed0 (127.11.49.67:36697)
I20260924 12:53:29.952103 19746 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:38573
I20260924 12:53:29.954246 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab.
Entry for principal oryx/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab.
WARNING: no policy specified for oryx/127.11.49.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab.
Entry for principal oryx/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab.
WARNING: no policy specified for oryx/127.11.49.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab.
Entry for principal oryx/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab.
I20260924 12:53:30.135876 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 19807
Sep 24 12:53:30 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:53:30.155953 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:30.137353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46592 (local address 127.11.49.65:40841)
0924 12:53:30.138450 (+ 1097us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:30.138459 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:30.138496 (+ 37us) server_negotiation.cc:407] Connection header received
0924 12:53:30.138578 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:30.138586 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:30.138875 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:30.139057 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:30.140641 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:30.142086 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:30.143460 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:30.144170 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:30.144467 (+ 297us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:30.149000 (+ 4533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:30.149024 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:30.149044 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:30.149110 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:30.152383 (+ 3273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:30.153347 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:30.153357 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:30.153360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:30.153619 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:30.154099 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:30.154103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:30.154105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:30.154625 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:30.154973 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:30.155297 (+ 324us) server_negotiation.cc:299] Negotiation successful
0924 12:53:30.155602 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":881,"thread_start_us":718,"threads_started":1}
I20260924 12:53:30.157667 19930 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:30.255371 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 19807
I20260924 12:53:30.269862 20069 heartbeater.cc:503] Master 127.11.49.126:46457 was elected leader, sending a full tablet report...
I20260924 12:53:30.272732 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 19941
Sep 24 12:53:30 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:53:30.291996 20216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:30.273861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33452 (local address 127.11.49.66:41107)
0924 12:53:30.274642 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:30.274650 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:30.274684 (+ 34us) server_negotiation.cc:407] Connection header received
0924 12:53:30.274758 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:30.274766 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:30.275037 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:30.275203 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:30.276590 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:30.277759 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:30.279153 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:30.279849 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:30.279990 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:30.284927 (+ 4937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:30.284948 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:30.284969 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:30.285025 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:30.288580 (+ 3555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:30.289493 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:30.289501 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:30.289504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:30.289646 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:30.290047 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:30.290053 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:30.290057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:30.290506 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:30.290886 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:30.291223 (+ 337us) server_negotiation.cc:299] Negotiation successful
0924 12:53:30.291569 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":401,"threads_started":1}
I20260924 12:53:30.293871 20064 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:30.389926 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 19941
I20260924 12:53:30.407248 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 20075
Sep 24 12:53:30 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:53:30.428193 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:30.408692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37424 (local address 127.11.49.67:36697)
0924 12:53:30.409345 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:30.409354 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:30.409403 (+ 49us) server_negotiation.cc:407] Connection header received
0924 12:53:30.409487 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:30.409494 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:30.409771 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:30.410001 (+ 230us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:30.411571 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:30.412789 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:30.414236 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:30.414970 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:30.415130 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:30.420738 (+ 5608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:30.420758 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:30.420778 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:30.420852 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:30.424702 (+ 3850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:30.425574 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:30.425582 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:30.425585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:30.425753 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:30.426242 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:30.426247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:30.426249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:30.426752 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:30.427074 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:30.427432 (+ 358us) server_negotiation.cc:299] Negotiation successful
0924 12:53:30.427821 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":290,"threads_started":1}
I20260924 12:53:30.429908 20198 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:30.525596 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 20075
I20260924 12:53:30.542383 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 19714
I20260924 12:53:30.544011 19776 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:30.649513 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 19714
I20260924 12:53:30.671360 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:46457
--webserver_interface=127.11.49.126
--webserver_port=34235
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:46457
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:31.084538 20221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:31.084957 20221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:31.085156 20221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:31.093694 20221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:53:31.093876 20221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:31.093994 20221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:31.094106 20221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:53:31.094194 20221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:53:31.105921 20221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:46457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:46457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=34235
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:31.107787 20221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:31.109596 20221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:31.125169 20227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:31.125169 20226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:31.125852 20229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:31.127005 20221 server_base.cc:1034] running on GCE node
I20260924 12:53:31.128400 20221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:31.130966 20221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:31.132223 20221 hybrid_clock.cc:648] HybridClock initialized: now 1790254411132133 us; error 89 us; skew 500 ppm
I20260924 12:53:31.132771 20221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:31 dist-test-slave-m9hg krb5kdc[19701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254411, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:31.137006 20221 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:53:31.139127 20221 webserver.cc:460] Webserver started at http://127.11.49.126:34235/ using document root <none> and password file <none>
I20260924 12:53:31.140036 20221 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:31.140219 20221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:31.147473 20221 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260924 12:53:31.151263 20236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:31.153158 20221 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:53:31.153424 20221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "01ca8cc735304b71a254301b2e1bae98"
format_stamp: "Formatted at 2026-09-24 12:53:27 on dist-test-slave-m9hg"
server_key: "6ba388acf3bdaecbe0585b8a1dcaf021"
server_key_iv: "a88bbd3b6b4e48cb874e0148c9291ecf"
server_key_version: "encryptionkey@0"
I20260924 12:53:31.154745 20221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:31.178293 20221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:31.183888 20221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:31.184294 20221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:31.208241 20221 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:46457
I20260924 12:53:31.208312 20287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:46457 every 8 connection(s)
I20260924 12:53:31.210304 20221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:53:31.217941 20288 sys_catalog.cc:263] Verifying existing consensus state
I20260924 12:53:31.220346 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 20221
I20260924 12:53:31.221421 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:40841
--local_ip_for_outbound_sockets=127.11.49.65
--tserver_master_addrs=127.11.49.126:46457
--webserver_port=33755
--webserver_interface=127.11.49.65
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.49.65
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:53:31.222061 20288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98: Bootstrap starting.
I20260924 12:53:31.244807 20288 log.cc:824] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:31.254027 20288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 12:53:31.254621 20288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98: Bootstrap complete.
I20260924 12:53:31.264475 20288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } }
I20260924 12:53:31.265352 20288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01ca8cc735304b71a254301b2e1bae98, State: Initialized, Role: FOLLOWER
I20260924 12:53:31.266044 20288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } }
I20260924 12:53:31.266299 20288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:53:31.266424 20288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:53:31.266608 20288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 1 FOLLOWER]: Advancing to term 2
I20260924 12:53:31.270673 20288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } }
I20260924 12:53:31.271268 20288 leader_election.cc:302] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01ca8cc735304b71a254301b2e1bae98; no voters:
I20260924 12:53:31.271961 20288 leader_election.cc:288] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260924 12:53:31.272100 20292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 2 FOLLOWER]: Leader election won for term 2
I20260924 12:53:31.273801 20292 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [term 2 LEADER]: Becoming Leader. State: Replica: 01ca8cc735304b71a254301b2e1bae98, State: Running, Role: LEADER
I20260924 12:53:31.274559 20292 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } }
I20260924 12:53:31.274803 20288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:53:31.279071 20294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01ca8cc735304b71a254301b2e1bae98. Latest consensus state: current_term: 2 leader_uuid: "01ca8cc735304b71a254301b2e1bae98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } } }
I20260924 12:53:31.279700 20294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:31.280484 20293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "01ca8cc735304b71a254301b2e1bae98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01ca8cc735304b71a254301b2e1bae98" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 46457 } } }
I20260924 12:53:31.280900 20293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98 [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:31.291713 20300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:53:31.300329 20300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:53:31.302258 20300 catalog_manager.cc:1259] Loaded cluster ID: 509df26a19414e61af7cae49523f036d
I20260924 12:53:31.302554 20300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:53:31.307111 20300 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:53:31.309712 20300 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 01ca8cc735304b71a254301b2e1bae98: Loaded TSK: 0
I20260924 12:53:31.311754 20300 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260924 12:53:31.663206 20290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:31.663692 20290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:31.663890 20290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:31.672526 20290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:31.672734 20290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:31.672942 20290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:53:31.686002 20290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.65.keytab
--principal=oryx/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:40841
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=33755
--tserver_master_addrs=127.11.49.126:46457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:31.687891 20290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:31.689658 20290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:31.708778 20315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:31.708740 20314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:31.709282 20317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:31.710855 20290 server_base.cc:1034] running on GCE node
I20260924 12:53:31.711647 20290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:31.712947 20290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:31.714329 20290 hybrid_clock.cc:648] HybridClock initialized: now 1790254411714224 us; error 91 us; skew 500 ppm
I20260924 12:53:31.714780 20290 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:31 dist-test-slave-m9hg krb5kdc[19701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254411, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:31.719210 20290 init.cc:377] Logged in from keytab as oryx/127.11.49.65@KRBTEST.COM (short username oryx)
I20260924 12:53:31.721736 20290 webserver.cc:460] Webserver started at http://127.11.49.65:33755/ using document root <none> and password file <none>
I20260924 12:53:31.722848 20290 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:31.723083 20290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:31.731072 20290 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260924 12:53:31.735322 20324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:31.737485 20290 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260924 12:53:31.737737 20290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "2c32b8e08689427a9f79f1e81e71faea"
format_stamp: "Formatted at 2026-09-24 12:53:28 on dist-test-slave-m9hg"
server_key: "a8b58821cffc66854253dd43fac311c6"
server_key_iv: "4449f0c926b9b3c0e281fbb0d2a2051b"
server_key_version: "encryptionkey@0"
I20260924 12:53:31.738873 20290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:31.763434 20290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:31.768595 20290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:31.768936 20290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:31.770172 20290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:31.771746 20290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:31.771899 20290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:31.772035 20290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:31.772125 20290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:31.813239 20290 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:40841
I20260924 12:53:31.813345 20436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:40841 every 8 connection(s)
I20260924 12:53:31.814872 20290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:53:31.816960 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 20290
I20260924 12:53:31.817576 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:41107
--local_ip_for_outbound_sockets=127.11.49.66
--tserver_master_addrs=127.11.49.126:46457
--webserver_port=39807
--webserver_interface=127.11.49.66
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.49.66
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:53:31 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:31 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
W20260924 12:53:32.237005 20441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:32.237486 20441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:32.237684 20441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:32.246420 20441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:32.246734 20441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:32.246955 20441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:53:32.258659 20441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.66.keytab
--principal=oryx/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:41107
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=39807
--tserver_master_addrs=127.11.49.126:46457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:32.260636 20441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:32.262351 20441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:32.283229 20448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:32.283628 20447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:32.284341 20450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:32.285341 20441 server_base.cc:1034] running on GCE node
I20260924 12:53:32.286664 20441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:32.288715 20441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:32.290186 20441 hybrid_clock.cc:648] HybridClock initialized: now 1790254412290107 us; error 75 us; skew 500 ppm
I20260924 12:53:32.290840 20441 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:32 dist-test-slave-m9hg krb5kdc[19701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254412, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:32.297700 20441 init.cc:377] Logged in from keytab as oryx/127.11.49.66@KRBTEST.COM (short username oryx)
I20260924 12:53:32.300967 20441 webserver.cc:460] Webserver started at http://127.11.49.66:39807/ using document root <none> and password file <none>
I20260924 12:53:32.302592 20441 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:32.302845 20441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:32.314566 20441 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.007s sys 0.000s
I20260924 12:53:32.318799 20457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:32.320494 20441 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260924 12:53:32.320699 20441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "4a1f4b2aeaab4f3c8ec2db27cc2c7152"
format_stamp: "Formatted at 2026-09-24 12:53:29 on dist-test-slave-m9hg"
server_key: "1a0c19cfa59251ecc71f794f14f2d000"
server_key_iv: "3eb0f3e371a1e1489efb4234bfc242c9"
server_key_version: "encryptionkey@0"
I20260924 12:53:32.321811 20441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:32.339958 20441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:32.345744 20441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:32.345990 20441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:32.347486 20441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:32.349278 20441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:32.349385 20441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:32.349489 20441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:32.349574 20441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:32.396229 20441 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:41107
I20260924 12:53:32.396329 20569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:41107 every 8 connection(s)
I20260924 12:53:32.397781 20441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:53:32.399503 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 20441
I20260924 12:53:32.400750 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:36697
--local_ip_for_outbound_sockets=127.11.49.67
--tserver_master_addrs=127.11.49.126:46457
--webserver_port=36841
--webserver_interface=127.11.49.67
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.49.67
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:53:32 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:32 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
W20260924 12:53:33.017093 20440 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.182s user 0.000s sys 0.018s
W20260924 12:53:33.019186 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:31.819019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:49235 (local address 127.11.49.126:46457)
0924 12:53:31.819976 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:31.819997 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:31.820812 (+ 815us) server_negotiation.cc:407] Connection header received
0924 12:53:31.823444 (+ 2632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:31.823470 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:31.824024 (+ 554us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:31.824560 (+ 536us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:31.827360 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:31.829502 (+ 2142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:31.831654 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:31.832923 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:31.833163 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.018413 (+1185250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:49235: BlockingRecv error: recv got EOF from 127.11.49.65:49235 (error 108)
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":350,"threads_started":1}
I20260924 12:53:33.019191 20440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:31.819217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:49235)
0924 12:53:31.820543 (+ 1326us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:31.820606 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:31.822674 (+ 2068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:31.824925 (+ 2251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:31.824943 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:31.826069 (+ 1126us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:31.827023 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:31.827054 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:31.829813 (+ 2759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:31.829819 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:31.831402 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:31.831427 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:31.833278 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:31.833285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:31.833592 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:31.834605 (+ 1013us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:31.834637 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:33.018005 (+1183368us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":940,"thread_start_us":727,"threads_started":1}
W20260924 12:53:33.020498 20437 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:46457 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.49.126:46457: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Sep 24 12:53:33 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:33 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:33.034369 20440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:33.021246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:38555)
0924 12:53:33.021518 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:33.021538 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:33.021708 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:33.022080 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:33.022084 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:33.022473 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:33.022631 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:33.022640 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.023781 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.023787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:33.024872 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:33.024884 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.025758 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.025764 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:33.025977 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.030189 (+ 4212us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:33.030210 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:33.034056 (+ 3846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153}
W20260924 12:53:33.034559 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:33.021350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:38555 (local address 127.11.49.126:46457)
0924 12:53:33.021514 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:33.021519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:33.021627 (+ 108us) server_negotiation.cc:407] Connection header received
0924 12:53:33.021867 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:33.021873 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:33.021942 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:33.022051 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:33.022777 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.023627 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.025025 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.025434 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.025712 (+ 278us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.034299 (+ 8587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:38555: BlockingRecv error: recv got EOF from 127.11.49.65:38555 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Sep 24 12:53:33 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:33 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:33.044482 20440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:33.035374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:59771)
0924 12:53:33.035689 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:33.035704 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:33.035855 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:33.036200 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:33.036206 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:33.036570 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:33.036735 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:33.036744 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.037798 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.037803 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:33.038749 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:33.038760 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.039657 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.039662 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:33.039843 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.040522 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:33.040539 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:33.044146 (+ 3607us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234}
W20260924 12:53:33.044641 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:33.035431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:59771 (local address 127.11.49.126:46457)
0924 12:53:33.035592 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:33.035596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:33.035786 (+ 190us) server_negotiation.cc:407] Connection header received
0924 12:53:33.035986 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:33.035991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:33.036064 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:33.036162 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:33.036889 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.037641 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.038900 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.039500 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.039628 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.044395 (+ 4767us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:59771: BlockingRecv error: recv got EOF from 127.11.49.65:59771 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260924 12:53:33.045025 20437 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260924 12:53:33.080405 20574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:33.081189 20574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:33.081506 20574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:33.102945 20574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:33.103293 20574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:33.103660 20574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:53:33.132068 20574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/krb5kdc/oryx_127.11.49.67.keytab
--principal=oryx/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:36697
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=36841
--tserver_master_addrs=127.11.49.126:46457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:33.135831 20574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:33.139272 20574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:33.164569 20581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:33.165159 20580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:33.165465 20583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:33.166194 20574 server_base.cc:1034] running on GCE node
I20260924 12:53:33.166887 20574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:33.168011 20574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:33.171449 20574 hybrid_clock.cc:648] HybridClock initialized: now 1790254413171319 us; error 138 us; skew 500 ppm
I20260924 12:53:33.171955 20574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:33 dist-test-slave-m9hg krb5kdc[19701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254413, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:33.176496 20574 init.cc:377] Logged in from keytab as oryx/127.11.49.67@KRBTEST.COM (short username oryx)
I20260924 12:53:33.178550 20574 webserver.cc:460] Webserver started at http://127.11.49.67:36841/ using document root <none> and password file <none>
I20260924 12:53:33.179667 20574 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:33.179869 20574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:33.185722 20574 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:53:33.189252 20590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:33.191676 20574 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260924 12:53:33.191959 20574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "9743c037561e4aadbfafdf5c54c00ed0"
format_stamp: "Formatted at 2026-09-24 12:53:29 on dist-test-slave-m9hg"
server_key: "80f2539f36ef3c1fdd9bcbb99a1aaf02"
server_key_iv: "18d4f19275fa81e5657303e7ddb675a1"
server_key_version: "encryptionkey@0"
I20260924 12:53:33.193440 20574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:33.206688 20574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:33.213055 20574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:33.213383 20574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:33.214623 20574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:33.216262 20574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:33.216424 20574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260924 12:53:33.216548 20574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:33.216634 20574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:33.268831 20574 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:36697
I20260924 12:53:33.268878 20702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:36697 every 8 connection(s)
I20260924 12:53:33.270372 20574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:53:33.279179 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 20574
Sep 24 12:53:33 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:33 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:33.329101 20707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:33.280848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44252 (local address 127.11.49.126:46457)
0924 12:53:33.297056 (+ 16208us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:33.297068 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:33.297325 (+ 257us) server_negotiation.cc:407] Connection header received
0924 12:53:33.297468 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:33.297478 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:33.297689 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:33.297924 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:33.300541 (+ 2617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.302778 (+ 2237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.305229 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.306362 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.306619 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.313248 (+ 6629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:33.313270 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:33.313311 (+ 41us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:33.313406 (+ 95us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:33.320097 (+ 6691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:33.322300 (+ 2203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:33.322317 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:33.322334 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:33.322734 (+ 400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:33.324029 (+ 1295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:33.324039 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:33.324046 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:33.325494 (+ 1448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:33.326125 (+ 631us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:33.327402 (+ 1277us) server_negotiation.cc:299] Negotiation successful
0924 12:53:33.328233 (+ 831us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15937,"thread_start_us":16288,"threads_started":1}
W20260924 12:53:33.743436 20572 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.324s user 0.000s sys 0.018s
W20260924 12:53:33.745230 20573 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:32.402160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:43805 (local address 127.11.49.126:46457)
0924 12:53:32.412728 (+ 10568us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:32.412732 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:32.412751 (+ 19us) server_negotiation.cc:407] Connection header received
0924 12:53:32.412803 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:32.412807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:32.412870 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:32.412999 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:32.414679 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:32.415457 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:32.417234 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:32.417936 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:32.418072 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.744824 (+1326752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:43805: BlockingRecv error: recv got EOF from 127.11.49.66:43805 (error 108)
Metrics: {"server-negotiator.queue_time_us":10453,"thread_start_us":10315,"threads_started":1}
I20260924 12:53:33.745987 20572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:32.401511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:43805)
0924 12:53:32.408471 (+ 6960us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:32.408535 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:32.410359 (+ 1824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:32.413307 (+ 2948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:32.413316 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:32.413884 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:32.414485 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:32.414503 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:32.415627 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:32.415634 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:32.416985 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:32.416997 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:32.418437 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:32.418447 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:32.418779 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:32.419561 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:32.419585 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:33.744541 (+1324956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":6607,"thread_start_us":6375,"threads_started":1}
W20260924 12:53:33.747643 20570 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:46457 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.49.126:46457: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Sep 24 12:53:33 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:33 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:33.765424 20572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:33.748977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:43989)
0924 12:53:33.749337 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:33.749358 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:33.749533 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:33.750095 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:33.750100 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:33.750641 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:33.750952 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:33.750967 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.752588 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.752602 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:33.755306 (+ 2704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:33.755341 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.756709 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.756722 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:33.757059 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.758148 (+ 1089us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:33.758190 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:33.765034 (+ 6844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227}
W20260924 12:53:33.765630 20573 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:33.749051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:43989 (local address 127.11.49.126:46457)
0924 12:53:33.749272 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:33.749280 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:33.749516 (+ 236us) server_negotiation.cc:407] Connection header received
0924 12:53:33.749723 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:33.749734 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:33.749868 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:33.750064 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:33.751195 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.752260 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.755669 (+ 3409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.756264 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.756543 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.765349 (+ 8806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:43989: BlockingRecv error: recv got EOF from 127.11.49.66:43989 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Sep 24 12:53:33 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:33 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:33.779991 20572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:33.766962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:52093)
0924 12:53:33.767416 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:33.767451 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:33.767604 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:33.768025 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:33.768029 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:33.768632 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:33.768928 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:33.768942 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.770147 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.770154 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:33.771289 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:33.771304 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.772180 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.772188 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:33.772471 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.773290 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:33.773312 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:33.779596 (+ 6284us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":86}
W20260924 12:53:33.780187 20573 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:33.767311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:52093 (local address 127.11.49.126:46457)
0924 12:53:33.767500 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:33.767508 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:33.767530 (+ 22us) server_negotiation.cc:407] Connection header received
0924 12:53:33.767774 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:33.767779 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:33.767864 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:33.767988 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:33.769099 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.769968 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.771469 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.771974 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.772129 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.779855 (+ 7726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:52093: BlockingRecv error: recv got EOF from 127.11.49.66:52093 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260924 12:53:33.780709 20570 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 24 12:53:34 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:34 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
W20260924 12:53:34.058676 20573 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:34.046182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:42297 (local address 127.11.49.126:46457)
0924 12:53:34.046451 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:34.046461 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:34.047065 (+ 604us) server_negotiation.cc:407] Connection header received
0924 12:53:34.047379 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:34.047383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:34.047451 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:34.047565 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:34.048603 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.049402 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.050656 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.051169 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.051300 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:34.058378 (+ 7078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:42297: BlockingRecv error: recv got EOF from 127.11.49.65:42297 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
I20260924 12:53:34.058758 20709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:34.045988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:42297)
0924 12:53:34.046930 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:34.046961 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:34.047214 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:34.047596 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:34.047601 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:34.048163 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:34.048407 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:34.048422 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.049566 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.049569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:34.050507 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:34.050517 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.051358 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.051364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:34.051534 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:34.052206 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:34.052224 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:34.058079 (+ 5855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":823,"thread_start_us":689,"threads_started":1}
W20260924 12:53:34.486545 20705 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.199s user 0.007s sys 0.011s
W20260924 12:53:34.488026 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:33.273677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:56215 (local address 127.11.49.126:46457)
0924 12:53:33.273986 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:33.273994 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:33.275277 (+ 1283us) server_negotiation.cc:407] Connection header received
0924 12:53:33.277612 (+ 2335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:33.277623 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:33.277795 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:33.278032 (+ 237us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:33.279951 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.281105 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.284462 (+ 3357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.285445 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.285581 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:34.487760 (+1202179us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:56215: BlockingRecv error: recv got EOF from 127.11.49.67:56215 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
I20260924 12:53:34.488338 20705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:33.274066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:56215)
0924 12:53:33.274969 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:33.275058 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:33.277242 (+ 2184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:33.278273 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:33.278282 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:33.278937 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:33.279709 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:33.279730 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.281390 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.281400 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:33.284175 (+ 2775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:33.284199 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:33.286022 (+ 1823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:33.286032 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:33.286468 (+ 436us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:33.287688 (+ 1220us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:33.287731 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:34.487332 (+1199601us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":384,"threads_started":1}
W20260924 12:53:34.489552 20703 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:46457 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.49.126:46457: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Sep 24 12:53:34 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:34 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:34.502231 20705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:34.490641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:42889)
0924 12:53:34.490921 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:34.490948 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:34.491113 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:34.491621 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:34.491630 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:34.492337 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:34.492587 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:34.492600 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.493838 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.493851 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:34.495046 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:34.495062 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.495992 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.495998 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:34.496149 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:34.496987 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:34.497009 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:34.501950 (+ 4941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":97}
W20260924 12:53:34.502552 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:34.490726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:42889 (local address 127.11.49.126:46457)
0924 12:53:34.490964 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:34.490969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:34.491017 (+ 48us) server_negotiation.cc:407] Connection header received
0924 12:53:34.491304 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:34.491313 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:34.491416 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:34.491522 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:34.492756 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.493654 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.495220 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.495749 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.495858 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:34.502231 (+ 6373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:42889: BlockingRecv error: recv got EOF from 127.11.49.67:42889 (error 108)
Metrics: {"server-negotiator.queue_time_us":120}
Sep 24 12:53:34 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:34 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:34.513420 20705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:34.503572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:35837)
0924 12:53:34.503756 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:34.503779 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:34.503915 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:34.504386 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:34.504391 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:34.504805 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:34.505005 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:34.505015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.506106 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.506112 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:34.507202 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:34.507213 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.507999 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.508006 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:34.508232 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:34.509023 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:34.509043 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:34.513183 (+ 4140us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":42}
W20260924 12:53:34.513772 20703 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260924 12:53:34.513839 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:34.503858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:35837 (local address 127.11.49.126:46457)
0924 12:53:34.504046 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:34.504051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:34.504074 (+ 23us) server_negotiation.cc:407] Connection header received
0924 12:53:34.504127 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:34.504132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:34.504189 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:34.504332 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:34.505161 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.505956 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.507355 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.507829 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.507978 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:34.513525 (+ 5547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:35837: BlockingRecv error: recv got EOF from 127.11.49.67:35837 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 24 12:53:34 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:34 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:34.792802 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:34.781591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:41707)
0924 12:53:34.782344 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:34.782368 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:34.782597 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:34.783087 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:34.783091 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:34.783629 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:34.783820 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:34.783830 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.785031 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.785036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:34.786139 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:34.786155 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.787027 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.787033 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:34.787199 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:34.787991 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:34.788013 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:34.792380 (+ 4367us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":439,"threads_started":1}
W20260924 12:53:34.793273 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:34.781689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:41707 (local address 127.11.49.126:46457)
0924 12:53:34.781948 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:34.781957 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:34.782508 (+ 551us) server_negotiation.cc:407] Connection header received
0924 12:53:34.782801 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:34.782806 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:34.782893 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:34.782987 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:34.783995 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.784841 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.786334 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:34.786752 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:34.786867 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:34.792738 (+ 5871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:41707: BlockingRecv error: recv got EOF from 127.11.49.66:41707 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Sep 24 12:53:35 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:35 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:35.073257 20711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:35.060586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:51137)
0924 12:53:35.061173 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:35.061226 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:35.061362 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:35.061795 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:35.061802 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:35.062360 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:35.062561 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:35.062571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.064496 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.064504 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:35.066105 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:35.066139 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.067303 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.067310 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:35.067557 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:35.068322 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:35.068346 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:35.072927 (+ 4581us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":335,"threads_started":1}
W20260924 12:53:35.073359 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:35.060838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:51137 (local address 127.11.49.126:46457)
0924 12:53:35.061083 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:35.061090 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:35.061338 (+ 248us) server_negotiation.cc:407] Connection header received
0924 12:53:35.061503 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:35.061510 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:35.061612 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:35.061716 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:35.062809 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.064200 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.066423 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.067063 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.067244 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:35.073141 (+ 5897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:51137: BlockingRecv error: recv got EOF from 127.11.49.65:51137 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Sep 24 12:53:35 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:35 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:35.526800 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:35.514777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:34337)
0924 12:53:35.515566 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:35.515595 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:35.515753 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:35.516200 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:35.516204 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:35.516805 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:35.517020 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:35.517032 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.518377 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.518384 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:35.519535 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:35.519555 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.520600 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.520608 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:35.520819 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:35.521696 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:35.521732 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:35.526455 (+ 4723us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":464,"threads_started":1}
W20260924 12:53:35.527268 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:35.514882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:34337 (local address 127.11.49.126:46457)
0924 12:53:35.515082 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:35.515086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:35.515742 (+ 656us) server_negotiation.cc:407] Connection header received
0924 12:53:35.515869 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:35.515873 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:35.515943 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:35.516053 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:35.517223 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.518135 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.519795 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.520258 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.520468 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:35.526952 (+ 6484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:34337: BlockingRecv error: recv got EOF from 127.11.49.67:34337 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Sep 24 12:53:35 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:35 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:35.806447 20713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:35.794253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:34481)
0924 12:53:35.794919 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:35.794939 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:35.795095 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:35.795536 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:35.795541 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:35.796030 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:35.796249 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:35.796258 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.797851 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.797856 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:35.798885 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:35.798899 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.800319 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.800325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:35.800497 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:35.801344 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:35.801378 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:35.805967 (+ 4589us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":405,"threads_started":1}
W20260924 12:53:35.806598 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:35.794314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:34481 (local address 127.11.49.126:46457)
0924 12:53:35.794620 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:35.794631 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:35.795052 (+ 421us) server_negotiation.cc:407] Connection header received
0924 12:53:35.795233 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:35.795238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:35.795318 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:35.795435 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:35.796646 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.797658 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.799155 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:35.800049 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:35.800207 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:35.806308 (+ 6101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:34481: BlockingRecv error: recv got EOF from 127.11.49.66:34481 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Sep 24 12:53:36 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:36 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:36.086627 20714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:36.074592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:40843)
0924 12:53:36.075384 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:36.075407 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:36.075581 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:36.076017 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:36.076021 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:36.076543 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:36.076813 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:36.076823 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.078217 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.078222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:36.079204 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:36.079217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.080165 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.080171 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:36.080406 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:36.081304 (+ 898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:36.081333 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:36.086363 (+ 5030us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":478,"threads_started":1}
W20260924 12:53:36.087193 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:36.074956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:40843 (local address 127.11.49.126:46457)
0924 12:53:36.075253 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:36.075260 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:36.075534 (+ 274us) server_negotiation.cc:407] Connection header received
0924 12:53:36.075711 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:36.075716 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:36.075795 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:36.075911 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:36.077051 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.078025 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.079412 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.079945 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.080084 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:36.086859 (+ 6775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:40843: BlockingRecv error: recv got EOF from 127.11.49.65:40843 (error 108)
Metrics: {"server-negotiator.queue_time_us":127}
Sep 24 12:53:36 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:36 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:36.539541 20715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:36.528038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:58097)
0924 12:53:36.528739 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:36.528766 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:36.529027 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:36.529453 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:36.529458 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:36.530005 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:36.530243 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:36.530253 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.531466 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.531474 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:36.532533 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:36.532547 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.533398 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.533404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:36.533609 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:36.534399 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:36.534420 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:36.539274 (+ 4854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":410,"threads_started":1}
W20260924 12:53:36.539921 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:36.528149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:58097 (local address 127.11.49.126:46457)
0924 12:53:36.528558 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:36.528567 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:36.528930 (+ 363us) server_negotiation.cc:407] Connection header received
0924 12:53:36.529201 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:36.529206 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:36.529282 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:36.529420 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:36.530442 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.531291 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.532707 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.533194 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.533383 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:36.539598 (+ 6215us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:58097: BlockingRecv error: recv got EOF from 127.11.49.67:58097 (error 108)
Metrics: {"server-negotiator.queue_time_us":167}
Sep 24 12:53:36 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:36 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:36.818634 20716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:36.807762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:39589)
0924 12:53:36.808401 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:36.808455 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:36.808632 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:36.809039 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:36.809043 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:36.809437 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:36.809630 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:36.809638 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.810723 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.810732 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:36.811652 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:36.811663 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.812417 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.812423 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:36.812614 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:36.813473 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:36.813498 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:36.818270 (+ 4772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":302,"threads_started":1}
W20260924 12:53:36.819015 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:36.807964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:39589 (local address 127.11.49.126:46457)
0924 12:53:36.808389 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:36.808401 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:36.808571 (+ 170us) server_negotiation.cc:407] Connection header received
0924 12:53:36.808774 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:36.808782 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:36.808894 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:36.808996 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:36.809790 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.810587 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.811803 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:36.812233 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:36.812401 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:36.818682 (+ 6281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:39589: BlockingRecv error: recv got EOF from 127.11.49.66:39589 (error 108)
Metrics: {"server-negotiator.queue_time_us":161}
Sep 24 12:53:37 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:37 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:37.099272 20717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:37.088340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:56741)
0924 12:53:37.089013 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:37.089034 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:37.089233 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:37.089602 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:37.089618 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:37.090063 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:37.090235 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:37.090244 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.091273 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.091278 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:37.092472 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:37.092485 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.093290 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.093296 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:37.093485 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:37.094267 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:37.094286 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:37.098931 (+ 4645us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":383,"threads_started":1}
W20260924 12:53:37.099514 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:37.088441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:56741 (local address 127.11.49.126:46457)
0924 12:53:37.088657 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:37.088665 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:37.089152 (+ 487us) server_negotiation.cc:407] Connection header received
0924 12:53:37.089386 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:37.089391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:37.089457 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:37.089563 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:37.090398 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.091127 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.092619 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.093132 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.093270 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:37.099216 (+ 5946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:56741: BlockingRecv error: recv got EOF from 127.11.49.65:56741 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Sep 24 12:53:37 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:37 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:37.550803 20718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:37.540582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:47921)
0924 12:53:37.541154 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:37.541177 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:37.541305 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:37.541746 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:37.541749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:37.542090 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:37.542315 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:37.542324 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.543682 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.543688 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:37.544782 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:37.544794 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.545640 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.545644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:37.545784 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:37.546517 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:37.546536 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:37.550471 (+ 3935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":288,"threads_started":1}
W20260924 12:53:37.550995 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:37.540729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:47921 (local address 127.11.49.126:46457)
0924 12:53:37.540999 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:37.541005 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:37.541275 (+ 270us) server_negotiation.cc:407] Connection header received
0924 12:53:37.541501 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:37.541506 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:37.541588 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:37.541705 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:37.542507 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.543531 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.544957 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.545484 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.545618 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:37.550744 (+ 5126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:47921: BlockingRecv error: recv got EOF from 127.11.49.67:47921 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Sep 24 12:53:37 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:37 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:37.831259 20719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:37.819799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:58711)
0924 12:53:37.820566 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:37.820593 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:37.820787 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:37.821265 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:37.821271 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:37.821753 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:37.821988 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:37.821997 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.823038 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.823043 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:37.824362 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:37.824386 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.825171 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.825177 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:37.825402 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:37.826252 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:37.826274 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:37.830819 (+ 4545us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":340,"threads_started":1}
W20260924 12:53:37.831414 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:37.819914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:58711 (local address 127.11.49.126:46457)
0924 12:53:37.820175 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:37.820193 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:37.820760 (+ 567us) server_negotiation.cc:407] Connection header received
0924 12:53:37.820931 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:37.820939 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:37.821027 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:37.821170 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:37.822138 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.822873 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.824535 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:37.824947 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:37.825099 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:37.831059 (+ 5960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:58711: BlockingRecv error: recv got EOF from 127.11.49.66:58711 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Sep 24 12:53:38 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:38 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:38.115907 20720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:38.100666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:34417)
0924 12:53:38.101273 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:38.101294 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:38.101426 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:38.101872 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:38.101876 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:38.102301 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:38.102459 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:38.102468 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.103845 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.103849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:38.105103 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:38.105117 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.106187 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.106192 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:38.106348 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:38.111380 (+ 5032us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:38.111402 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:38.115643 (+ 4241us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":327,"threads_started":1}
W20260924 12:53:38.116448 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:38.100920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:34417 (local address 127.11.49.126:46457)
0924 12:53:38.101146 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:38.101152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:38.101440 (+ 288us) server_negotiation.cc:407] Connection header received
0924 12:53:38.101585 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:38.101590 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:38.101674 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:38.101777 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:38.102686 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.103617 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.105309 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.105906 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.106167 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:38.116104 (+ 9937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:34417: BlockingRecv error: recv got EOF from 127.11.49.65:34417 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Sep 24 12:53:38 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:38 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:38.563542 20721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:38.552143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:40691)
0924 12:53:38.552766 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:38.552790 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:38.552937 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:38.553330 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:38.553333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:38.553733 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:38.553915 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:38.553923 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.555154 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.555160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:38.556395 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:38.556408 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.557350 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.557355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:38.557506 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:38.558260 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:38.558279 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:38.563184 (+ 4905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":348,"threads_started":1}
W20260924 12:53:38.563763 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:38.552250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:40691 (local address 127.11.49.126:46457)
0924 12:53:38.552593 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:38.552600 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:38.552912 (+ 312us) server_negotiation.cc:407] Connection header received
0924 12:53:38.553065 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:38.553069 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:38.553168 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:38.553267 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:38.554108 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.554947 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.556604 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.557137 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.557292 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:38.563449 (+ 6157us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:40691: BlockingRecv error: recv got EOF from 127.11.49.67:40691 (error 108)
Metrics: {"server-negotiator.queue_time_us":149}
Sep 24 12:53:38 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:38 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:38.844435 20722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:38.832616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:51529)
0924 12:53:38.833271 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:38.833290 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:38.833427 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:38.833876 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:38.833880 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:38.834342 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:38.834500 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:38.834509 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.835729 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.835734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:38.837094 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:38.837110 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.838080 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.838090 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:38.838371 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:38.839401 (+ 1030us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:38.839430 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:38.843989 (+ 4559us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":332,"threads_started":1}
W20260924 12:53:38.844544 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:38.833018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:51529 (local address 127.11.49.126:46457)
0924 12:53:38.833245 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:38.833250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:38.833375 (+ 125us) server_negotiation.cc:407] Connection header received
0924 12:53:38.833549 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:38.833600 (+ 51us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:38.833674 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:38.833780 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:38.834712 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.835493 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.837242 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:38.837736 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:38.837837 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:38.844358 (+ 6521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:51529: BlockingRecv error: recv got EOF from 127.11.49.66:51529 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Sep 24 12:53:39 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:39 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:39.129541 20723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:39.117446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:57983)
0924 12:53:39.118038 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:39.118073 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:39.118223 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:39.118730 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:39.118734 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:39.119167 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:39.119344 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:39.119353 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.120797 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.120804 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:39.122018 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:39.122033 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.123122 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.123128 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:39.123361 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:39.124168 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:39.124192 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:39.129283 (+ 5091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":331,"threads_started":1}
W20260924 12:53:39.129916 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:39.117699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:57983 (local address 127.11.49.126:46457)
0924 12:53:39.117931 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:39.117937 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:39.118219 (+ 282us) server_negotiation.cc:407] Connection header received
0924 12:53:39.118347 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:39.118352 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:39.118454 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:39.118587 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:39.119542 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.120539 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.122222 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.122886 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.123085 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:39.129578 (+ 6493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:57983: BlockingRecv error: recv got EOF from 127.11.49.65:57983 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Sep 24 12:53:39 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:39 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:39.577425 20724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:39.565031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:49621)
0924 12:53:39.565809 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:39.565837 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:39.566078 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:39.566611 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:39.566616 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:39.567196 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:39.567426 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:39.567438 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.569090 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.569099 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:39.570321 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:39.570337 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.571202 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.571209 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:39.571447 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:39.572304 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:39.572326 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:39.577020 (+ 4694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":403,"threads_started":1}
W20260924 12:53:39.577641 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:39.565351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:49621 (local address 127.11.49.126:46457)
0924 12:53:39.565679 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:39.565688 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:39.565969 (+ 281us) server_negotiation.cc:407] Connection header received
0924 12:53:39.566254 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:39.566262 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:39.566420 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:39.566571 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:39.567611 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.568919 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.570495 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.571020 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.571181 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:39.577327 (+ 6146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:49621: BlockingRecv error: recv got EOF from 127.11.49.67:49621 (error 108)
Metrics: {"server-negotiator.queue_time_us":128}
Sep 24 12:53:39 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:39 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:39.856551 20725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:39.845839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:57341)
0924 12:53:39.846456 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:39.846475 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:39.846609 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:39.847012 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:39.847017 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:39.847475 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:39.847672 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:39.847683 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.849037 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.849042 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:39.850011 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:39.850023 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.850923 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.850928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:39.851058 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:39.851783 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:39.851801 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:39.856114 (+ 4313us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":367,"threads_started":1}
W20260924 12:53:39.856886 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:39.845881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:57341 (local address 127.11.49.126:46457)
0924 12:53:39.846189 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:39.846199 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:39.846573 (+ 374us) server_negotiation.cc:407] Connection header received
0924 12:53:39.846742 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:39.846746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:39.846827 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:39.846928 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:39.847829 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.848865 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.850181 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:39.850749 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:39.850867 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:39.856427 (+ 5560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:57341: BlockingRecv error: recv got EOF from 127.11.49.66:57341 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Sep 24 12:53:40 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:40 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:40.142537 20726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:40.130848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:50997)
0924 12:53:40.131699 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:40.131723 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:40.131930 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:40.132334 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:40.132341 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:40.132789 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:40.132982 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:40.132990 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.134280 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.134291 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:40.135866 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:40.135887 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.136917 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.136924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:40.137076 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:40.137917 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:40.137939 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:40.142166 (+ 4227us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":377,"threads_started":1}
W20260924 12:53:40.142745 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:40.131094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:50997 (local address 127.11.49.126:46457)
0924 12:53:40.131441 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:40.131451 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:40.131841 (+ 390us) server_negotiation.cc:407] Connection header received
0924 12:53:40.132079 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:40.132084 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:40.132155 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:40.132267 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:40.133156 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.134058 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.136043 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.136668 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.136785 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:40.142452 (+ 5667us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:50997: BlockingRecv error: recv got EOF from 127.11.49.65:50997 (error 108)
Metrics: {"server-negotiator.queue_time_us":148}
Sep 24 12:53:40 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:40 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:40.593145 20727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:40.578793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:47443)
0924 12:53:40.579392 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:40.579420 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:40.579594 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:40.579951 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:40.579955 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:40.580546 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:40.580764 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:40.580775 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.581810 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.581814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:40.583035 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:40.583074 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.584326 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.584336 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:40.584550 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:40.585839 (+ 1289us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:40.585870 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:40.592514 (+ 6644us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":324,"threads_started":1}
W20260924 12:53:40.593328 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:40.578960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:47443 (local address 127.11.49.126:46457)
0924 12:53:40.579247 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:40.579254 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:40.579530 (+ 276us) server_negotiation.cc:407] Connection header received
0924 12:53:40.579724 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:40.579728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:40.579795 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:40.579900 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:40.580922 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.581659 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.583379 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.584049 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.584184 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:40.593045 (+ 8861us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:47443: BlockingRecv error: recv got EOF from 127.11.49.67:47443 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Sep 24 12:53:40 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:40 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:40.869619 20728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:40.857804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:56051)
0924 12:53:40.858491 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:40.858511 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:40.858653 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:40.859256 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:40.859260 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:40.859715 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:40.859955 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:40.859965 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.861254 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.861258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:40.862304 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:40.862316 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.863504 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.863510 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:40.863696 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:40.864564 (+ 868us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:40.864599 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:40.869148 (+ 4549us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":325,"threads_started":1}
W20260924 12:53:40.869726 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:40.857940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:56051 (local address 127.11.49.126:46457)
0924 12:53:40.858309 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:40.858318 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:40.858634 (+ 316us) server_negotiation.cc:407] Connection header received
0924 12:53:40.858848 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:40.858853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:40.859057 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:40.859201 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:40.860168 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.861088 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.862504 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:40.863288 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:40.863440 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:40.869452 (+ 6012us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:56051: BlockingRecv error: recv got EOF from 127.11.49.66:56051 (error 108)
Metrics: {"server-negotiator.queue_time_us":159}
Sep 24 12:53:41 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:41 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:41.155087 20729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:41.143935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:38085)
0924 12:53:41.144647 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:41.144672 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:41.144845 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:41.145254 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:41.145258 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:41.145764 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:41.146007 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:41.146019 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.147133 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.147139 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:41.148353 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:41.148372 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.149392 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.149403 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:41.149569 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:41.150455 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:41.150493 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:41.154773 (+ 4280us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":398,"threads_started":1}
W20260924 12:53:41.155380 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:41.144199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:38085 (local address 127.11.49.126:46457)
0924 12:53:41.144473 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:41.144480 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:41.144790 (+ 310us) server_negotiation.cc:407] Connection header received
0924 12:53:41.144975 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:41.144979 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:41.145050 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:41.145147 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:41.146180 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.146940 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.148537 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.149141 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.149283 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:41.155047 (+ 5764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:38085: BlockingRecv error: recv got EOF from 127.11.49.65:38085 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
Sep 24 12:53:41 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:41 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:41.606761 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:41.594579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:38287)
0924 12:53:41.595401 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:41.595429 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:41.595629 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:41.596054 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:41.596058 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:41.596739 (+ 681us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:41.596975 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:41.596987 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.598361 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.598366 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:41.599575 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:41.599592 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.600793 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.600800 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:41.601044 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:41.601876 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:41.601909 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:41.606464 (+ 4555us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":339,"threads_started":1}
W20260924 12:53:41.607125 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:41.594940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:38287 (local address 127.11.49.126:46457)
0924 12:53:41.595212 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:41.595220 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:41.595588 (+ 368us) server_negotiation.cc:407] Connection header received
0924 12:53:41.595759 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:41.595763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:41.595835 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:41.595942 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:41.597209 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.598067 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.599778 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.600594 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.600715 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:41.606678 (+ 5963us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:38287: BlockingRecv error: recv got EOF from 127.11.49.67:38287 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Sep 24 12:53:41 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:41 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:41.884074 20731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:41.871010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:33899)
0924 12:53:41.871708 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:41.871727 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:41.871902 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:41.872348 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:41.872351 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:41.872851 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:41.873087 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:41.873095 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.874716 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.874724 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:41.876241 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:41.876260 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.877177 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.877182 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:41.877319 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:41.878224 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:41.878247 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:41.883710 (+ 5463us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":311,"threads_started":1}
W20260924 12:53:41.884228 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:41.871336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:33899 (local address 127.11.49.126:46457)
0924 12:53:41.871611 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:41.871619 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:41.871848 (+ 229us) server_negotiation.cc:407] Connection header received
0924 12:53:41.872039 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:41.872043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:41.872126 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:41.872257 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:41.873297 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.874490 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.876495 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:41.876956 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:41.877067 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:41.883988 (+ 6921us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:33899: BlockingRecv error: recv got EOF from 127.11.49.66:33899 (error 108)
Metrics: {"server-negotiator.queue_time_us":118}
Sep 24 12:53:42 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:42 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:42.169294 20732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:42.156624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:47547)
0924 12:53:42.157274 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:42.157303 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:42.157525 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:42.157950 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:42.157955 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:42.158530 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:42.158705 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:42.158715 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.160014 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.160020 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:42.161304 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:42.161319 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.162117 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.162124 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:42.162318 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:42.163126 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:42.163146 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:42.169009 (+ 5863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":302,"threads_started":1}
W20260924 12:53:42.169761 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:42.156944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:47547 (local address 127.11.49.126:46457)
0924 12:53:42.157228 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:42.157236 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:42.157429 (+ 193us) server_negotiation.cc:407] Connection header received
0924 12:53:42.157702 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:42.157707 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:42.157792 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:42.157914 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:42.158872 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.159838 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.161468 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.161916 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.162078 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:42.169412 (+ 7334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:47547: BlockingRecv error: recv got EOF from 127.11.49.65:47547 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Sep 24 12:53:42 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:42 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:42.621281 20733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:42.608464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:53165)
0924 12:53:42.609137 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:42.609165 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:42.609362 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:42.610047 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:42.610051 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:42.610588 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:42.610830 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:42.610841 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.612405 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.612414 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:42.613976 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:42.613997 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.615093 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.615099 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:42.615285 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:42.616117 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:42.616150 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:42.620972 (+ 4822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":339,"threads_started":1}
W20260924 12:53:42.622011 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:42.608735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:53165 (local address 127.11.49.126:46457)
0924 12:53:42.609033 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:42.609043 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:42.609308 (+ 265us) server_negotiation.cc:407] Connection header received
0924 12:53:42.609675 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:42.609680 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:42.609773 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:42.609909 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:42.611066 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.612160 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.614184 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.614864 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.615024 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:42.621705 (+ 6681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:53165: BlockingRecv error: recv got EOF from 127.11.49.67:53165 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Sep 24 12:53:42 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:42 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:42.897439 20734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:42.885803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:50819)
0924 12:53:42.886548 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:42.886567 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:42.886763 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:42.887119 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:42.887124 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:42.887610 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:42.887761 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:42.887769 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.888982 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.888989 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:42.889944 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:42.889954 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.890676 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.890682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:42.890860 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:42.891647 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:42.891677 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:42.897039 (+ 5362us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":402,"threads_started":1}
W20260924 12:53:42.897584 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:42.886010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:50819 (local address 127.11.49.126:46457)
0924 12:53:42.886327 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:42.886336 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:42.886677 (+ 341us) server_negotiation.cc:407] Connection header received
0924 12:53:42.886900 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:42.886906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:42.886975 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:42.887086 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:42.887899 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.888845 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.890085 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:42.890514 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:42.890659 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:42.897264 (+ 6605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:50819: BlockingRecv error: recv got EOF from 127.11.49.66:50819 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Sep 24 12:53:43 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:43 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:43.187085 20735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:43.170624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:50833)
0924 12:53:43.171353 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:43.171385 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:43.171552 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:43.172044 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:43.172048 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:43.172567 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:43.172766 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:43.172775 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.173881 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.173886 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:43.175019 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:43.175032 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.176195 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.176201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:43.176563 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:43.181766 (+ 5203us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:43.181797 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:43.186632 (+ 4835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":447,"threads_started":1}
W20260924 12:53:43.187110 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:43.170804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:50833 (local address 127.11.49.126:46457)
0924 12:53:43.171021 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:43.171026 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:43.171513 (+ 487us) server_negotiation.cc:407] Connection header received
0924 12:53:43.171731 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:43.171735 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:43.171809 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:43.171932 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:43.172951 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.173690 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.175470 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.175989 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.176131 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:43.186907 (+ 10776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:50833: BlockingRecv error: recv got EOF from 127.11.49.65:50833 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Sep 24 12:53:43 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:43 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:43.635196 20736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:43.622745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:34123)
0924 12:53:43.623415 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:43.623445 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:43.623605 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:43.624007 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:43.624011 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:43.624637 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:43.624832 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:43.624841 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.626046 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.626051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:43.627349 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:43.627365 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.628502 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.628509 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:43.628721 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:43.629464 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:43.629491 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:43.634903 (+ 5412us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":384,"threads_started":1}
W20260924 12:53:43.635754 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:43.622989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:34123 (local address 127.11.49.126:46457)
0924 12:53:43.623206 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:43.623211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:43.623569 (+ 358us) server_negotiation.cc:407] Connection header received
0924 12:53:43.623713 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:43.623717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:43.623786 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:43.623902 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:43.625034 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.625834 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.627582 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.628196 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.628434 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:43.635348 (+ 6914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:34123: BlockingRecv error: recv got EOF from 127.11.49.67:34123 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Sep 24 12:53:43 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:43 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:43.910142 20737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:43.898927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:38231)
0924 12:53:43.899594 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:43.899620 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:43.899859 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:43.900332 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:43.900337 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:43.900815 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:43.901025 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:43.901035 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.902163 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.902169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:43.903237 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:43.903251 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.904111 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.904118 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:43.904340 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:43.905343 (+ 1003us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:43.905364 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:43.909629 (+ 4265us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":331,"threads_started":1}
W20260924 12:53:43.910286 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:43.899236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:38231 (local address 127.11.49.126:46457)
0924 12:53:43.899586 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:43.899593 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:43.899758 (+ 165us) server_negotiation.cc:407] Connection header received
0924 12:53:43.900063 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:43.900068 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:43.900139 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:43.900265 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:43.901201 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.902002 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.903415 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:43.903924 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:43.904087 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:43.909947 (+ 5860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:38231: BlockingRecv error: recv got EOF from 127.11.49.66:38231 (error 108)
Metrics: {"server-negotiator.queue_time_us":122}
Sep 24 12:53:44 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:44 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:44.200042 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:44.188598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:38505)
0924 12:53:44.189281 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:44.189319 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:44.189489 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:44.190012 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:44.190016 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:44.190535 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:44.190785 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:44.190794 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.192053 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.192057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:44.193357 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:44.193372 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.194385 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.194392 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:44.194594 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:44.195383 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:44.195403 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:44.199717 (+ 4314us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":393,"threads_started":1}
W20260924 12:53:44.200354 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:44.188839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:38505 (local address 127.11.49.126:46457)
0924 12:53:44.189039 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:44.189044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:44.189463 (+ 419us) server_negotiation.cc:407] Connection header received
0924 12:53:44.189663 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:44.189667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:44.189760 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:44.189883 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:44.190969 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.191815 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.193564 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.194183 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.194316 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:44.199989 (+ 5673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:38505: BlockingRecv error: recv got EOF from 127.11.49.65:38505 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Sep 24 12:53:44 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:44 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:44.647403 20739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:44.636692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:53825)
0924 12:53:44.637406 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:44.637440 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:44.637642 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:44.638150 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:44.638154 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:44.638605 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:44.638805 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:44.638815 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.639851 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.639855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:44.641027 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:44.641039 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.641756 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.641760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:44.641929 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:44.642697 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:44.642718 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:44.647105 (+ 4387us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":392,"threads_started":1}
W20260924 12:53:44.647542 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:44.636769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:53825 (local address 127.11.49.126:46457)
0924 12:53:44.637015 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:44.637024 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:44.637567 (+ 543us) server_negotiation.cc:407] Connection header received
0924 12:53:44.637861 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:44.637869 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:44.637970 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:44.638074 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:44.638979 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.639703 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.641169 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.641572 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.641692 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:44.647301 (+ 5609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:53825: BlockingRecv error: recv got EOF from 127.11.49.67:53825 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Sep 24 12:53:44 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:44 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:44.922423 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:44.911588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:48391)
0924 12:53:44.912237 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:44.912265 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:44.912520 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:44.912917 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:44.912920 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:44.913428 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:44.913660 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:44.913669 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.914879 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.914884 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:44.915974 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:44.915989 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.916893 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.916925 (+ 32us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:44.917085 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:44.917881 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:44.917902 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:44.922138 (+ 4236us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":470,"threads_started":1}
W20260924 12:53:44.922861 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:44.911792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:48391 (local address 127.11.49.126:46457)
0924 12:53:44.912042 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:44.912053 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:44.912419 (+ 366us) server_negotiation.cc:407] Connection header received
0924 12:53:44.912691 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:44.912696 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:44.912768 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:44.912870 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:44.913819 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.914670 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.916141 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:44.916706 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:44.916823 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:44.922342 (+ 5519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:48391: BlockingRecv error: recv got EOF from 127.11.49.66:48391 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Sep 24 12:53:45 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:45 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:45.213158 20741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:45.201433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:49989)
0924 12:53:45.202161 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:45.202185 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:45.202329 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:45.202832 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:45.202836 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:45.203293 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:45.203569 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:45.203584 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.205224 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.205228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:45.206472 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:45.206485 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.207361 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.207368 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:45.207562 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:45.208354 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:45.208375 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:45.212849 (+ 4474us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":410,"threads_started":1}
W20260924 12:53:45.213441 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:45.201670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:49989 (local address 127.11.49.126:46457)
0924 12:53:45.201892 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:45.201898 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:45.202293 (+ 395us) server_negotiation.cc:407] Connection header received
0924 12:53:45.202528 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:45.202533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:45.202619 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:45.202768 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:45.203793 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.205025 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.206671 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.207151 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.207315 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:45.213120 (+ 5805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:49989: BlockingRecv error: recv got EOF from 127.11.49.65:49989 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Sep 24 12:53:45 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:45 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:45.659185 20742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:45.648830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:58041)
0924 12:53:45.649613 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:45.649646 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:45.649845 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:45.650232 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:45.650236 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:45.650770 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:45.650959 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:45.650968 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.652008 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.652015 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:45.653032 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:45.653046 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.653815 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.653820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:45.654018 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:45.654853 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:45.654872 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:45.658807 (+ 3935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":672,"thread_start_us":503,"threads_started":1}
W20260924 12:53:45.659370 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:45.649054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:58041 (local address 127.11.49.126:46457)
0924 12:53:45.649401 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:45.649409 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:45.649761 (+ 352us) server_negotiation.cc:407] Connection header received
0924 12:53:45.649997 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:45.650004 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:45.650076 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:45.650208 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:45.651115 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.651866 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.653200 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.653629 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.653771 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:45.659020 (+ 5249us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:58041: BlockingRecv error: recv got EOF from 127.11.49.67:58041 (error 108)
Metrics: {"server-negotiator.queue_time_us":154}
Sep 24 12:53:45 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:45 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:45.936993 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:45.923945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:48689)
0924 12:53:45.924736 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:45.924756 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:45.925015 (+ 259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:45.925455 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:45.925460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:45.925965 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:45.926247 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:45.926257 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.927648 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.927653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:45.928956 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:45.928978 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.930084 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.930092 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:45.930323 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:45.931294 (+ 971us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:45.931319 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:45.936641 (+ 5322us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":480,"threads_started":1}
W20260924 12:53:45.937337 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:45.924104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:48689 (local address 127.11.49.126:46457)
0924 12:53:45.924399 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:45.924408 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:45.924883 (+ 475us) server_negotiation.cc:407] Connection header received
0924 12:53:45.925206 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:45.925211 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:45.925277 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:45.925413 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:45.926413 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.927429 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.929191 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:45.929815 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:45.929986 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:45.936998 (+ 7012us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:48689: BlockingRecv error: recv got EOF from 127.11.49.66:48689 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Sep 24 12:53:46 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:46 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
W20260924 12:53:46.225720 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:46.214604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:59651 (local address 127.11.49.126:46457)
0924 12:53:46.214833 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:46.214839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:46.215452 (+ 613us) server_negotiation.cc:407] Connection header received
0924 12:53:46.215671 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:46.215676 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:46.215758 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:46.215863 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:46.216741 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.217640 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.218919 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.219429 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.219573 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:46.225449 (+ 5876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:59651: BlockingRecv error: recv got EOF from 127.11.49.65:59651 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260924 12:53:46.225926 20744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:46.214545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:59651)
0924 12:53:46.215338 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:46.215363 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:46.215531 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:46.215892 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:46.215897 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:46.216427 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:46.216584 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:46.216592 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.217816 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.217820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:46.218761 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:46.218772 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.219591 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.219597 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:46.219782 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:46.220626 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:46.220646 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:46.225087 (+ 4441us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":435,"threads_started":1}
Sep 24 12:53:46 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:46 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:46.672747 20745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:46.660715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:58239)
0924 12:53:46.661437 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:46.661461 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:46.661594 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:46.662173 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:46.662186 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:46.662610 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:46.662858 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:46.662868 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.664259 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.664264 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:46.665591 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:46.665606 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.666944 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.666950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:46.667171 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:46.667963 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:46.667982 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:46.672472 (+ 4490us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":424,"threads_started":1}
W20260924 12:53:46.673345 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:46.660834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:58239 (local address 127.11.49.126:46457)
0924 12:53:46.661109 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:46.661115 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:46.661594 (+ 479us) server_negotiation.cc:407] Connection header received
0924 12:53:46.661856 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:46.661862 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:46.661945 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:46.662054 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:46.663096 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.664024 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.665758 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.666715 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.666854 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:46.672925 (+ 6071us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:58239: BlockingRecv error: recv got EOF from 127.11.49.67:58239 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Sep 24 12:53:46 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:46 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:46.950088 20746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:46.938587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:55801)
0924 12:53:46.939304 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:46.939332 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:46.939507 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:46.940119 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:46.940123 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:46.940671 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:46.940875 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:46.940886 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.942099 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.942104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:46.943297 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:46.943313 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.944526 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.944533 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:46.944749 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:46.945597 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:46.945618 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:46.949788 (+ 4170us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":423,"threads_started":1}
W20260924 12:53:46.950486 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:46.938969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:55801 (local address 127.11.49.126:46457)
0924 12:53:46.939204 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:46.939209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:46.939471 (+ 262us) server_negotiation.cc:407] Connection header received
0924 12:53:46.939745 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:46.939750 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:46.939866 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:46.939998 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:46.941084 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.941893 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.943519 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:46.944291 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:46.944443 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:46.950083 (+ 5640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:55801: BlockingRecv error: recv got EOF from 127.11.49.66:55801 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Sep 24 12:53:47 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:47 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:47.239108 20747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:47.227734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:49341)
0924 12:53:47.228426 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:47.228450 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:47.228587 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:47.228984 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:47.228988 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:47.229399 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:47.229623 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:47.229634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.230853 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.230857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:47.232010 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:47.232023 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.232874 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.232881 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:47.233035 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:47.233808 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:47.233828 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:47.238660 (+ 4832us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":351,"threads_started":1}
W20260924 12:53:47.239181 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:47.227966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:49341 (local address 127.11.49.126:46457)
0924 12:53:47.228220 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:47.228226 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:47.228549 (+ 323us) server_negotiation.cc:407] Connection header received
0924 12:53:47.228718 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:47.228723 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:47.228804 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:47.228929 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:47.229807 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.230639 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.232198 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.232693 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.232811 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:47.238917 (+ 6106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:49341: BlockingRecv error: recv got EOF from 127.11.49.65:49341 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Sep 24 12:53:47 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:47 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.67@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:47.685766 20748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:47.673915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.67:38177)
0924 12:53:47.674730 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:47.674754 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:47.674881 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:47.675448 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:47.675455 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:47.676226 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:47.676535 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:47.676547 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.677761 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.677767 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:47.678766 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:47.678781 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.679643 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.679649 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:47.679854 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:47.680758 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:47.680779 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:47.685336 (+ 4557us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":543,"threads_started":1}
W20260924 12:53:47.685839 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:47.674157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:38177 (local address 127.11.49.126:46457)
0924 12:53:47.674513 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:47.674521 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:47.674856 (+ 335us) server_negotiation.cc:407] Connection header received
0924 12:53:47.675076 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:47.675083 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:47.675213 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:47.675330 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:47.676721 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.677522 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.678939 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.679390 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.679532 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:47.685605 (+ 6073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.67:38177: BlockingRecv error: recv got EOF from 127.11.49.67:38177 (error 108)
Metrics: {"server-negotiator.queue_time_us":187}
Sep 24 12:53:47 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:47 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.66@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:47.963406 20749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:47.951771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.66:45491)
0924 12:53:47.952432 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:47.952450 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:47.952582 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:47.953040 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:47.953046 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:47.953562 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:47.953839 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:47.953848 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.955346 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.955350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:47.956421 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:47.956435 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.957354 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.957360 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:47.957527 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:47.958347 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:47.958369 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:47.963123 (+ 4754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":337,"threads_started":1}
W20260924 12:53:47.963825 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:47.951979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:45491 (local address 127.11.49.126:46457)
0924 12:53:47.952199 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:47.952205 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:47.952558 (+ 353us) server_negotiation.cc:407] Connection header received
0924 12:53:47.952708 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:47.952714 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:47.952839 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:47.952963 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:47.954030 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.955150 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.956606 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:47.957154 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:47.957296 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:47.963482 (+ 6186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.66:45491: BlockingRecv error: recv got EOF from 127.11.49.66:45491 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Sep 24 12:53:48 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
Sep 24 12:53:48 dist-test-slave-m9hg krb5kdc[19701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.49.65@KRBTEST.COM for oryx/127.11.49.126@KRBTEST.COM, Server not found in Kerberos database
I20260924 12:53:48.255277 20750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:48.240599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:46457 (local address 127.11.49.65:34327)
0924 12:53:48.241288 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:48.241313 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:48.241465 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:48.241894 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:48.241898 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:48.242341 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:48.242525 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:48.242533 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:48.243937 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:48.243941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:48.245108 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:48.245122 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:48.245941 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:48.245945 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:48.246074 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:48.250499 (+ 4425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:48.250529 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:48.254971 (+ 4442us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.49.126:46457: Server oryx/127.11.49.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":396,"threads_started":1}
W20260924 12:53:48.255645 20439 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:48.240673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:34327 (local address 127.11.49.126:46457)
0924 12:53:48.240968 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:48.240979 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:48.241424 (+ 445us) server_negotiation.cc:407] Connection header received
0924 12:53:48.241604 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:48.241609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:48.241690 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:48.241804 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:48.242699 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:48.243748 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:48.245278 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:48.245766 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:48.245886 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:48.255290 (+ 9404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.49.65:34327: BlockingRecv error: recv got EOF from 127.11.49.65:34327 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
I20260924 12:53:48.288437 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 20290
I20260924 12:53:48.305576 20752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:48.290028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46938 (local address 127.11.49.65:40841)
0924 12:53:48.290788 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:48.290797 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:48.290845 (+ 48us) server_negotiation.cc:407] Connection header received
0924 12:53:48.290934 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:48.290942 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:48.291246 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:48.291485 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:48.293493 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:48.294947 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:48.296502 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:48.297632 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:48.297797 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:48.300949 (+ 3152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:48.300966 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:48.300987 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:48.301048 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:48.304823 (+ 3775us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.49.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0924 12:53:48.305257 (+ 434us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46938: Request ticket server kudu/127.11.49.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":356,"threads_started":1}
W20260924 12:53:48.305732 20752 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46938: Request ticket server kudu/127.11.49.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260924 12:53:48.305783 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 20290: Not authorized: Client connection negotiation failed: client connection to 127.11.49.65:40841: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.49.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260924 12:53:48.306077 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 20290
I20260924 12:53:48.326761 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 20441
I20260924 12:53:48.342912 20753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:48.328536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53234 (local address 127.11.49.66:41107)
0924 12:53:48.329371 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:48.329380 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:48.329419 (+ 39us) server_negotiation.cc:407] Connection header received
0924 12:53:48.329513 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:48.329522 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:48.329824 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:48.330053 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:48.331676 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:48.333124 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:48.334774 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:48.335500 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:48.335661 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:48.338626 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:48.338638 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:48.338657 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:48.338714 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:48.342186 (+ 3472us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.49.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0924 12:53:48.342616 (+ 430us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53234: Request ticket server kudu/127.11.49.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":426,"threads_started":1}
W20260924 12:53:48.343091 20753 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53234: Request ticket server kudu/127.11.49.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260924 12:53:48.343345 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 20441: Not authorized: Client connection negotiation failed: client connection to 127.11.49.66:41107: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.49.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260924 12:53:48.343518 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 20441
I20260924 12:53:48.362123 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 20574
I20260924 12:53:48.378805 20754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:48.363602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50326 (local address 127.11.49.67:36697)
0924 12:53:48.364373 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:48.364381 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:48.364411 (+ 30us) server_negotiation.cc:407] Connection header received
0924 12:53:48.364489 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:48.364495 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:48.365028 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:48.365263 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:48.367687 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:48.369015 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:48.370514 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:48.371198 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:48.371334 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:48.374635 (+ 3301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:48.374646 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:48.374661 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:48.374712 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:48.378144 (+ 3432us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.49.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0924 12:53:48.378498 (+ 354us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50326: Request ticket server kudu/127.11.49.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":334,"threads_started":1}
W20260924 12:53:48.378901 20754 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50326: Request ticket server kudu/127.11.49.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260924 12:53:48.379272 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 20574: Not authorized: Client connection negotiation failed: client connection to 127.11.49.67:36697: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.49.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260924 12:53:48.379495 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 20574
I20260924 12:53:48.398159 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 20221
I20260924 12:53:48.399829 20283 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:48.519229 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 20221
2026-09-24T12:53:48Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22592 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-24T12:53:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:53:48Z Disabled control of system clock
I20260924 12:53:48.611370 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38483
--webserver_interface=127.11.49.126
--webserver_port=0
--builtin_ntp_servers=127.11.49.84:38229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:38483
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260924 12:53:48.965313 20759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:48.965651 20759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:48.965828 20759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:48.974135 20759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:53:48.974280 20759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:48.974323 20759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:48.974380 20759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:53:48.974421 20759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:53:48.984674 20759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:38229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:38483
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:48.986135 20759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:48.987922 20759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:49.001732 20764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:49.001868 20765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:49.001986 20767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:49.003919 20759 server_base.cc:1034] running on GCE node
I20260924 12:53:49.004941 20759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:49.006647 20759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:49.008051 20759 hybrid_clock.cc:648] HybridClock initialized: now 1790254429007967 us; error 95 us; skew 500 ppm
I20260924 12:53:49.008656 20759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:53:49.011746 20759 webserver.cc:460] Webserver started at http://127.11.49.126:43259/ using document root <none> and password file <none>
I20260924 12:53:49.012637 20759 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:49.012779 20759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:49.013137 20759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:49.016227 20759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "da52dfa941494996a07cbe2bbc019e5f"
format_stamp: "Formatted at 2026-09-24 12:53:49 on dist-test-slave-m9hg"
server_key: "eb7fbed821ee7497b82906da0887c734"
server_key_iv: "b88e44e860070421cef8b9d196231891"
server_key_version: "encryptionkey@0"
I20260924 12:53:49.017198 20759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "da52dfa941494996a07cbe2bbc019e5f"
format_stamp: "Formatted at 2026-09-24 12:53:49 on dist-test-slave-m9hg"
server_key: "eb7fbed821ee7497b82906da0887c734"
server_key_iv: "b88e44e860070421cef8b9d196231891"
server_key_version: "encryptionkey@0"
I20260924 12:53:49.023413 20759 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260924 12:53:49.028103 20773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:49.030169 20759 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260924 12:53:49.030457 20759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "da52dfa941494996a07cbe2bbc019e5f"
format_stamp: "Formatted at 2026-09-24 12:53:49 on dist-test-slave-m9hg"
server_key: "eb7fbed821ee7497b82906da0887c734"
server_key_iv: "b88e44e860070421cef8b9d196231891"
server_key_version: "encryptionkey@0"
I20260924 12:53:49.030753 20759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:49.045414 20759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:49.046401 20759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:49.046772 20759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:49.070422 20759 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:38483
I20260924 12:53:49.070492 20824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:38483 every 8 connection(s)
I20260924 12:53:49.072147 20759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:53:49.077534 20825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:49.078598 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 20759
I20260924 12:53:49.078838 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:53:49.079784 11461 external_mini_cluster.cc:1428] Setting key c15594f20bc45ebd92032cf022aded1e
I20260924 12:53:49.095832 20825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f: Bootstrap starting.
I20260924 12:53:49.097746 20828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:49.082852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60842 (local address 127.11.49.126:38483)
0924 12:53:49.084459 (+ 1607us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:49.084473 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:49.084531 (+ 58us) server_negotiation.cc:407] Connection header received
0924 12:53:49.086505 (+ 1974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:49.086533 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:49.087219 (+ 686us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:49.087837 (+ 618us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:49.088568 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:49.090072 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:49.091652 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:49.092979 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:49.093247 (+ 268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:49.094716 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:49.094725 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:49.094744 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:49.095459 (+ 715us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:49.095576 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:49.095600 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:49.095755 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:49.096017 (+ 262us) server_negotiation.cc:299] Negotiation successful
0924 12:53:49.096459 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":894,"thread_start_us":528,"threads_started":1}
I20260924 12:53:49.101438 20825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:49.102958 20825 log.cc:824] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:49.107177 20825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f: No bootstrap required, opened a new log
I20260924 12:53:49.116797 20825 raft_consensus.cc:348] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da52dfa941494996a07cbe2bbc019e5f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38483 } }
I20260924 12:53:49.117406 20825 raft_consensus.cc:374] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:49.117543 20825 raft_consensus.cc:729] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da52dfa941494996a07cbe2bbc019e5f, State: Initialized, Role: FOLLOWER
I20260924 12:53:49.118364 20825 consensus_queue.cc:260] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da52dfa941494996a07cbe2bbc019e5f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38483 } }
I20260924 12:53:49.118695 20825 raft_consensus.cc:388] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:53:49.118873 20825 raft_consensus.cc:482] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:53:49.119088 20825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:49.122030 20825 raft_consensus.cc:504] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da52dfa941494996a07cbe2bbc019e5f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38483 } }
I20260924 12:53:49.122788 20825 leader_election.cc:302] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da52dfa941494996a07cbe2bbc019e5f; no voters:
I20260924 12:53:49.123757 20825 leader_election.cc:288] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:53:49.123993 20830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:49.126377 20830 raft_consensus.cc:686] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [term 1 LEADER]: Becoming Leader. State: Replica: da52dfa941494996a07cbe2bbc019e5f, State: Running, Role: LEADER
I20260924 12:53:49.127231 20825 sys_catalog.cc:564] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:53:49.127189 20830 consensus_queue.cc:237] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da52dfa941494996a07cbe2bbc019e5f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38483 } }
I20260924 12:53:49.131934 20832 sys_catalog.cc:455] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader da52dfa941494996a07cbe2bbc019e5f. Latest consensus state: current_term: 1 leader_uuid: "da52dfa941494996a07cbe2bbc019e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da52dfa941494996a07cbe2bbc019e5f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38483 } } }
I20260924 12:53:49.133419 20832 sys_catalog.cc:458] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:49.133764 20831 sys_catalog.cc:455] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da52dfa941494996a07cbe2bbc019e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da52dfa941494996a07cbe2bbc019e5f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38483 } } }
I20260924 12:53:49.141350 20831 sys_catalog.cc:458] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:49.144574 20836 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:53:49.151625 20836 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:53:49.169032 20836 catalog_manager.cc:1347] Generated new cluster ID: 63e07abe1e94484e90237a1fe0208786
I20260924 12:53:49.169220 20836 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:53:49.187749 20836 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:53:49.189895 20836 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:53:49.205420 20836 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da52dfa941494996a07cbe2bbc019e5f: Generated new TSK 0
I20260924 12:53:49.206671 20836 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:53:49.220526 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38483
--builtin_ntp_servers=127.11.49.84:38229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260924 12:53:49.606033 20849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:49.606370 20849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:49.606459 20849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:49.614198 20849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:49.614331 20849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:49.614492 20849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:53:49.624186 20849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:38229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38483
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:49.625684 20849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:49.627624 20849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:49.643632 20854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:49.643688 20857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:49.643707 20855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:49.645466 20849 server_base.cc:1034] running on GCE node
I20260924 12:53:49.646440 20849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:49.647692 20849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:49.649037 20849 hybrid_clock.cc:648] HybridClock initialized: now 1790254429648993 us; error 63 us; skew 500 ppm
I20260924 12:53:49.649507 20849 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:53:49.652397 20849 webserver.cc:460] Webserver started at http://127.11.49.65:42825/ using document root <none> and password file <none>
I20260924 12:53:49.653188 20849 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:49.653326 20849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:49.653664 20849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:49.656708 20849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "df2e8a59a4b94fc980146860952214fd"
format_stamp: "Formatted at 2026-09-24 12:53:49 on dist-test-slave-m9hg"
server_key: "ac14af4c51a7002445f9f67500f4c74c"
server_key_iv: "79329105b40b213d413519be0c6a8a46"
server_key_version: "encryptionkey@0"
I20260924 12:53:49.657552 20849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "df2e8a59a4b94fc980146860952214fd"
format_stamp: "Formatted at 2026-09-24 12:53:49 on dist-test-slave-m9hg"
server_key: "ac14af4c51a7002445f9f67500f4c74c"
server_key_iv: "79329105b40b213d413519be0c6a8a46"
server_key_version: "encryptionkey@0"
I20260924 12:53:49.663741 20849 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260924 12:53:49.668251 20863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:49.670611 20849 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:53:49.670934 20849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "df2e8a59a4b94fc980146860952214fd"
format_stamp: "Formatted at 2026-09-24 12:53:49 on dist-test-slave-m9hg"
server_key: "ac14af4c51a7002445f9f67500f4c74c"
server_key_iv: "79329105b40b213d413519be0c6a8a46"
server_key_version: "encryptionkey@0"
I20260924 12:53:49.671239 20849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:49.688529 20849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:49.689567 20849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:49.689952 20849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:49.691394 20849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:49.693346 20849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:49.693493 20849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:49.693660 20849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:49.693761 20849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:49.744935 20849 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:40025
I20260924 12:53:49.745049 20975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:40025 every 8 connection(s)
I20260924 12:53:49.746507 20849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:53:49.754146 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 20849
I20260924 12:53:49.754426 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:53:49.755434 11461 external_mini_cluster.cc:1428] Setting key 863e85667b8d2a0e6fd3dc5f2adeed66
I20260924 12:53:49.760458 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38483
--builtin_ntp_servers=127.11.49.84:38229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260924 12:53:49.766913 20978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:49.750151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:47141 (local address 127.11.49.126:38483)
0924 12:53:49.750806 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:49.750811 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:49.752591 (+ 1780us) server_negotiation.cc:407] Connection header received
0924 12:53:49.756059 (+ 3468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:49.756064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:49.756165 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:49.756373 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:49.758808 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:49.760431 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:49.763575 (+ 3144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:49.764054 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:49.764201 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:49.765968 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:49.765975 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:49.765986 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:49.766007 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:49.766046 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:49.766057 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:49.766158 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:49.766429 (+ 271us) server_negotiation.cc:299] Negotiation successful
0924 12:53:49.766540 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":320,"threads_started":1}
I20260924 12:53:49.768149 20979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:49.750828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38483 (local address 127.11.49.65:47141)
0924 12:53:49.752246 (+ 1418us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:49.752401 (+ 155us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:49.755432 (+ 3031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:49.756977 (+ 1545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:49.756990 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:49.757139 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:49.758421 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:49.758463 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:49.760760 (+ 2297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:49.760770 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:49.763363 (+ 2593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:49.763385 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:49.764412 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:49.764423 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:49.764679 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:49.765497 (+ 818us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:53:49.765500 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:49.765546 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:53:49.765678 (+ 132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:49.766160 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:49.766173 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:49.766185 (+ 12us) client_negotiation.cc:769] Sending connection context
0924 12:53:49.766401 (+ 216us) client_negotiation.cc:240] Negotiation successful
0924 12:53:49.766851 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":437,"threads_started":1}
I20260924 12:53:49.769945 20976 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38483
I20260924 12:53:49.770314 20976 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:49.771162 20976 heartbeater.cc:511] Master 127.11.49.126:38483 requested a full tablet report, sending...
I20260924 12:53:49.776101 20790 ts_manager.cc:194] Registered new tserver with Master: df2e8a59a4b94fc980146860952214fd (127.11.49.65:40025)
I20260924 12:53:49.778427 20790 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.65:47141
W20260924 12:53:50.151021 20980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:50.151394 20980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:50.151549 20980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:50.159264 20980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:50.159416 20980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:50.159710 20980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:53:50.169513 20980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:38229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38483
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:50.170881 20980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:50.172787 20980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:50.189028 20986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:50.188963 20988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:50.189083 20985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:50.190649 20980 server_base.cc:1034] running on GCE node
I20260924 12:53:50.191464 20980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:50.192914 20980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:50.194207 20980 hybrid_clock.cc:648] HybridClock initialized: now 1790254430194149 us; error 53 us; skew 500 ppm
I20260924 12:53:50.194664 20980 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:53:50.197600 20980 webserver.cc:460] Webserver started at http://127.11.49.66:34183/ using document root <none> and password file <none>
I20260924 12:53:50.198509 20980 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:50.198660 20980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:50.198985 20980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:50.202136 20980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "6f14f81786524edf91dcf0f796fe572d"
format_stamp: "Formatted at 2026-09-24 12:53:50 on dist-test-slave-m9hg"
server_key: "c02e13e89a9f663f30998bfe29a002da"
server_key_iv: "dfab7fa3eb82a9bc3f1a5fe4969b7224"
server_key_version: "encryptionkey@0"
I20260924 12:53:50.203030 20980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "6f14f81786524edf91dcf0f796fe572d"
format_stamp: "Formatted at 2026-09-24 12:53:50 on dist-test-slave-m9hg"
server_key: "c02e13e89a9f663f30998bfe29a002da"
server_key_iv: "dfab7fa3eb82a9bc3f1a5fe4969b7224"
server_key_version: "encryptionkey@0"
I20260924 12:53:50.209399 20980 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260924 12:53:50.214002 20994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:50.215951 20980 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:53:50.216233 20980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "6f14f81786524edf91dcf0f796fe572d"
format_stamp: "Formatted at 2026-09-24 12:53:50 on dist-test-slave-m9hg"
server_key: "c02e13e89a9f663f30998bfe29a002da"
server_key_iv: "dfab7fa3eb82a9bc3f1a5fe4969b7224"
server_key_version: "encryptionkey@0"
I20260924 12:53:50.216575 20980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:50.244186 20980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:50.245182 20980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:50.245520 20980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:50.246680 20980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:50.248574 20980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:50.248709 20980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:50.248845 20980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:50.248924 20980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:50.291138 20980 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:43755
I20260924 12:53:50.291299 21106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:43755 every 8 connection(s)
I20260924 12:53:50.292666 20980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:53:50.301183 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 20980
I20260924 12:53:50.301388 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:53:50.301872 11461 external_mini_cluster.cc:1428] Setting key ea0439c2b0b54c151ab3a1d4038a28f0
I20260924 12:53:50.305536 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38483
--builtin_ntp_servers=127.11.49.84:38229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260924 12:53:50.310402 21109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:50.296017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:58633 (local address 127.11.49.126:38483)
0924 12:53:50.296650 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:50.296656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:50.298213 (+ 1557us) server_negotiation.cc:407] Connection header received
0924 12:53:50.300723 (+ 2510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:50.300731 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:50.300855 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:50.300998 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:50.302798 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:50.303720 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:50.306075 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:50.306882 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:50.307075 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:50.308905 (+ 1830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:50.308914 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:50.308922 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:50.308952 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:50.309009 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:50.309027 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:50.309139 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:50.309665 (+ 526us) server_negotiation.cc:299] Negotiation successful
0924 12:53:50.309886 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":342,"threads_started":1}
I20260924 12:53:50.311623 21110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:50.296721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38483 (local address 127.11.49.66:58633)
0924 12:53:50.297953 (+ 1232us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:50.298015 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:50.300218 (+ 2203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:50.301323 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:50.301335 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:50.301559 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:50.302461 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:50.302492 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:50.303988 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:50.303995 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:50.305851 (+ 1856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:50.305880 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:50.307190 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:50.307195 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:50.307474 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:50.308471 (+ 997us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:53:50.308474 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:50.308535 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:53:50.308650 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:50.309278 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:50.309291 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:50.309301 (+ 10us) client_negotiation.cc:769] Sending connection context
0924 12:53:50.309577 (+ 276us) client_negotiation.cc:240] Negotiation successful
0924 12:53:50.310160 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":345,"threads_started":1}
I20260924 12:53:50.313555 21107 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38483
I20260924 12:53:50.314026 21107 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:50.315254 21107 heartbeater.cc:511] Master 127.11.49.126:38483 requested a full tablet report, sending...
I20260924 12:53:50.317556 20790 ts_manager.cc:194] Registered new tserver with Master: 6f14f81786524edf91dcf0f796fe572d (127.11.49.66:43755)
I20260924 12:53:50.318938 20790 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.66:58633
W20260924 12:53:50.743283 21111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:50.743711 21111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:50.743816 21111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:50.753443 21111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:50.753633 21111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:50.753870 21111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:53:50.766433 21111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:38229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38483
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:50.768496 21111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:50.771040 21111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260924 12:53:50.783560 20976 heartbeater.cc:503] Master 127.11.49.126:38483 was elected leader, sending a full tablet report...
W20260924 12:53:50.790664 21117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:50.790664 21119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:50.790781 21116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:50.791352 21111 server_base.cc:1034] running on GCE node
I20260924 12:53:50.792330 21111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:50.793496 21111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:50.794800 21111 hybrid_clock.cc:648] HybridClock initialized: now 1790254430794706 us; error 89 us; skew 500 ppm
I20260924 12:53:50.795212 21111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:53:50.798192 21111 webserver.cc:460] Webserver started at http://127.11.49.67:43691/ using document root <none> and password file <none>
I20260924 12:53:50.799072 21111 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:50.799198 21111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:50.799580 21111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:50.802788 21111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "4b6f0c6592be49129bc29b1b35fb1045"
format_stamp: "Formatted at 2026-09-24 12:53:50 on dist-test-slave-m9hg"
server_key: "a200bb7dbc17767f0959edacad2fd4c4"
server_key_iv: "0864e96e97893e18c2c53aa62ccb79dd"
server_key_version: "encryptionkey@0"
I20260924 12:53:50.803655 21111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "4b6f0c6592be49129bc29b1b35fb1045"
format_stamp: "Formatted at 2026-09-24 12:53:50 on dist-test-slave-m9hg"
server_key: "a200bb7dbc17767f0959edacad2fd4c4"
server_key_iv: "0864e96e97893e18c2c53aa62ccb79dd"
server_key_version: "encryptionkey@0"
I20260924 12:53:50.809875 21111 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260924 12:53:50.814182 21125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:50.816077 21111 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:53:50.816385 21111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "4b6f0c6592be49129bc29b1b35fb1045"
format_stamp: "Formatted at 2026-09-24 12:53:50 on dist-test-slave-m9hg"
server_key: "a200bb7dbc17767f0959edacad2fd4c4"
server_key_iv: "0864e96e97893e18c2c53aa62ccb79dd"
server_key_version: "encryptionkey@0"
I20260924 12:53:50.816651 21111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:50.861331 21111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:50.862270 21111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:50.862594 21111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:50.863746 21111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:50.865644 21111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:50.865787 21111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:50.865932 21111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:50.866026 21111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:50.906360 21111 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:40155
I20260924 12:53:50.906479 21237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:40155 every 8 connection(s)
I20260924 12:53:50.907850 21111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:53:50.911051 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 21111
I20260924 12:53:50.911307 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:53:50.911974 11461 external_mini_cluster.cc:1428] Setting key 882a9157963d5c552373c7868705feee
I20260924 12:53:50.925959 21240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:50.911460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:37345 (local address 127.11.49.126:38483)
0924 12:53:50.912118 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:50.912126 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:50.914102 (+ 1976us) server_negotiation.cc:407] Connection header received
0924 12:53:50.916303 (+ 2201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:50.916309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:50.916425 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:50.916564 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:50.918255 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:50.919073 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:50.921842 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:50.922340 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:50.922758 (+ 418us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:50.924811 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:50.924818 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:50.924821 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:50.924846 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:50.924895 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:50.924910 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:50.925017 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:50.925312 (+ 295us) server_negotiation.cc:299] Negotiation successful
0924 12:53:50.925459 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":301,"threads_started":1}
I20260924 12:53:50.927513 21241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:50.912352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38483 (local address 127.11.49.67:37345)
0924 12:53:50.913855 (+ 1503us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:50.913912 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:50.915945 (+ 2033us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:50.916936 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:50.916950 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:50.917109 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:50.917966 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:50.917992 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:50.919304 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:50.919310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:50.921534 (+ 2224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:50.921566 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:50.922892 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:50.922903 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:50.923231 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:50.924238 (+ 1007us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:53:50.924241 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:50.924405 (+ 164us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:53:50.924528 (+ 123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:50.925024 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:50.925038 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:50.925048 (+ 10us) client_negotiation.cc:769] Sending connection context
0924 12:53:50.925290 (+ 242us) client_negotiation.cc:240] Negotiation successful
0924 12:53:50.925891 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"thread_start_us":450,"threads_started":1}
I20260924 12:53:50.929593 21238 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38483
I20260924 12:53:50.930006 21238 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:50.930874 21238 heartbeater.cc:511] Master 127.11.49.126:38483 requested a full tablet report, sending...
I20260924 12:53:50.932638 20790 ts_manager.cc:194] Registered new tserver with Master: 4b6f0c6592be49129bc29b1b35fb1045 (127.11.49.67:40155)
I20260924 12:53:50.933616 20790 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.67:37345
I20260924 12:53:50.943353 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260924 12:53:50.950529 21240 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:50.948565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60852 (local address 127.11.49.126:38483)
0924 12:53:50.948763 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:50.948768 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:50.949364 (+ 596us) server_negotiation.cc:407] Connection header received
0924 12:53:50.949577 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:50.949583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:50.949659 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:50.949770 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:50.950231 (+ 461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60852: BlockingRecv error: recv got EOF from 127.0.0.1:60852 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260924 12:53:50.951090 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 20849
I20260924 12:53:50.962028 21248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:50.952528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40958 (local address 127.11.49.65:40025)
0924 12:53:50.953253 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:50.953262 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:50.953292 (+ 30us) server_negotiation.cc:407] Connection header received
0924 12:53:50.953363 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:50.953371 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:50.953665 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:50.953860 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:50.954386 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:50.955791 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:50.957532 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:50.958257 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:50.958506 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:50.959952 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:50.959964 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:50.959984 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:50.960909 (+ 925us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:50.960976 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:50.961004 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:50.961165 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:50.961363 (+ 198us) server_negotiation.cc:299] Negotiation successful
0924 12:53:50.961547 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":354,"threads_started":1}
I20260924 12:53:50.963707 20971 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:51.052093 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 20849
I20260924 12:53:51.069537 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 20980
I20260924 12:53:51.080104 21250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:51.070866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52854 (local address 127.11.49.66:43755)
0924 12:53:51.071629 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:51.071639 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:51.071675 (+ 36us) server_negotiation.cc:407] Connection header received
0924 12:53:51.071777 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:51.071786 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:51.072092 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:51.072345 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:51.072842 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:51.074110 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:51.075597 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:51.076549 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:51.076730 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:51.078181 (+ 1451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:51.078191 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:51.078209 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:51.078993 (+ 784us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:51.079099 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:51.079125 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:51.079279 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:51.079495 (+ 216us) server_negotiation.cc:299] Negotiation successful
0924 12:53:51.079672 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":384,"threads_started":1}
I20260924 12:53:51.081653 21102 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:51.171339 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 20980
I20260924 12:53:51.190119 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 21111
I20260924 12:53:51.200984 21252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:51.191492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41570 (local address 127.11.49.67:40155)
0924 12:53:51.192398 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:51.192407 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:51.192445 (+ 38us) server_negotiation.cc:407] Connection header received
0924 12:53:51.192524 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:51.192532 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:51.192838 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:51.193011 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:51.193531 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:51.194817 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:51.196654 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:51.197467 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:51.197619 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:51.198899 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:51.198909 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:51.198928 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:51.199736 (+ 808us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:51.199804 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:51.199828 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:51.199962 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:51.200145 (+ 183us) server_negotiation.cc:299] Negotiation successful
0924 12:53:51.200429 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":430,"threads_started":1}
I20260924 12:53:51.202584 21233 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:51.291113 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 21111
I20260924 12:53:51.310251 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 20759
I20260924 12:53:51.311910 20820 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:51.428877 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 20759
2026-09-24T12:53:51Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2902 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-24T12:53:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:53:51Z Disabled control of system clock
I20260924 12:53:51.519627 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:40865
--webserver_interface=127.11.49.126
--webserver_port=0
--builtin_ntp_servers=127.11.49.84:34253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:40865
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260924 12:53:51.959456 21258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:51.959892 21258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:51.959992 21258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:51.968477 21258 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:53:51.968647 21258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:51.968689 21258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:51.968746 21258 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:53:51.968796 21258 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:53:51.979579 21258 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:40865
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:40865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:51.981429 21258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:51.983803 21258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:51.999320 21263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:51.999415 21264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:51.999974 21266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:52.001314 21258 server_base.cc:1034] running on GCE node
I20260924 12:53:52.002524 21258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:52.004791 21258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:52.006126 21258 hybrid_clock.cc:648] HybridClock initialized: now 1790254432006033 us; error 110 us; skew 500 ppm
I20260924 12:53:52.006711 21258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:53:52.010106 21258 webserver.cc:460] Webserver started at http://127.11.49.126:35997/ using document root <none> and password file <none>
I20260924 12:53:52.011164 21258 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:52.011327 21258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:52.011771 21258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:52.015775 21258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "0011ed28423d4484b14de4daa049f760"
format_stamp: "Formatted at 2026-09-24 12:53:52 on dist-test-slave-m9hg"
server_key: "b0e4b9e49971209912335325ef3c8e6f"
server_key_iv: "aedad37d9e6911f802415432cd7b32f8"
server_key_version: "encryptionkey@0"
I20260924 12:53:52.017020 21258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "0011ed28423d4484b14de4daa049f760"
format_stamp: "Formatted at 2026-09-24 12:53:52 on dist-test-slave-m9hg"
server_key: "b0e4b9e49971209912335325ef3c8e6f"
server_key_iv: "aedad37d9e6911f802415432cd7b32f8"
server_key_version: "encryptionkey@0"
I20260924 12:53:52.025036 21258 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260924 12:53:52.030304 21272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:52.032565 21258 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260924 12:53:52.032905 21258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "0011ed28423d4484b14de4daa049f760"
format_stamp: "Formatted at 2026-09-24 12:53:52 on dist-test-slave-m9hg"
server_key: "b0e4b9e49971209912335325ef3c8e6f"
server_key_iv: "aedad37d9e6911f802415432cd7b32f8"
server_key_version: "encryptionkey@0"
I20260924 12:53:52.033200 21258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:52.040228 21258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:52.041297 21258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:52.041656 21258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:52.065271 21258 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:40865
I20260924 12:53:52.065354 21323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:40865 every 8 connection(s)
I20260924 12:53:52.066989 21258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:53:52.072444 21324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:52.073199 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 21258
I20260924 12:53:52.073458 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:53:52.074156 11461 external_mini_cluster.cc:1428] Setting key 9ace93ceb35b0ab33819790fc516a445
I20260924 12:53:52.085199 21327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:52.076726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46858 (local address 127.11.49.126:40865)
0924 12:53:52.078165 (+ 1439us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:52.078179 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:52.078228 (+ 49us) server_negotiation.cc:407] Connection header received
0924 12:53:52.080788 (+ 2560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:52.080822 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:52.081419 (+ 597us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:52.081922 (+ 503us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:52.083194 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:52.083201 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:52.083215 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:52.083230 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:52.083299 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:52.083315 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:52.083588 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:52.083751 (+ 163us) server_negotiation.cc:299] Negotiation successful
0924 12:53:52.084018 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":829,"thread_start_us":502,"threads_started":1}
I20260924 12:53:52.090019 21324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760: Bootstrap starting.
I20260924 12:53:52.095185 21324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:52.097373 21324 log.cc:824] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:52.101856 21324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760: No bootstrap required, opened a new log
I20260924 12:53:52.112978 21324 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0011ed28423d4484b14de4daa049f760" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40865 } }
I20260924 12:53:52.113711 21324 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:52.113855 21324 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0011ed28423d4484b14de4daa049f760, State: Initialized, Role: FOLLOWER
I20260924 12:53:52.114859 21324 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0011ed28423d4484b14de4daa049f760" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40865 } }
I20260924 12:53:52.115245 21324 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:53:52.115435 21324 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:53:52.115674 21324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:52.119184 21324 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0011ed28423d4484b14de4daa049f760" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40865 } }
I20260924 12:53:52.119947 21324 leader_election.cc:302] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0011ed28423d4484b14de4daa049f760; no voters:
I20260924 12:53:52.120908 21324 leader_election.cc:288] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:53:52.121124 21329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:52.122326 21329 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [term 1 LEADER]: Becoming Leader. State: Replica: 0011ed28423d4484b14de4daa049f760, State: Running, Role: LEADER
I20260924 12:53:52.123024 21329 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0011ed28423d4484b14de4daa049f760" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40865 } }
I20260924 12:53:52.123682 21324 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:53:52.126967 21330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0011ed28423d4484b14de4daa049f760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0011ed28423d4484b14de4daa049f760" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40865 } } }
I20260924 12:53:52.126900 21331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0011ed28423d4484b14de4daa049f760. Latest consensus state: current_term: 1 leader_uuid: "0011ed28423d4484b14de4daa049f760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0011ed28423d4484b14de4daa049f760" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 40865 } } }
I20260924 12:53:52.127465 21330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:52.127549 21331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760 [sys.catalog]: This master's current role is: LEADER
W20260924 12:53:52.141497 21345 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 12:53:52.141718 21345 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 12:53:52.141930 21335 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:53:52.144418 21335 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:53:52.155725 21335 catalog_manager.cc:1347] Generated new cluster ID: 94000c70640c47d28e39cf8e3f6eb5bd
I20260924 12:53:52.155910 21335 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:53:52.205492 21335 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:53:52.206235 21335 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:53:52.216418 21335 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0011ed28423d4484b14de4daa049f760: Generated new TSK 0
I20260924 12:53:52.217684 21335 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:53:52.234763 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40865
--builtin_ntp_servers=127.11.49.84:34253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260924 12:53:52.674707 21348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:52.675168 21348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:52.675278 21348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:52.684568 21348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:52.684774 21348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:52.684916 21348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:53:52.696197 21348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40865
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:52.697937 21348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:52.700584 21348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:52.718238 21354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:52.718242 21356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:52.718169 21353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:52.719753 21348 server_base.cc:1034] running on GCE node
I20260924 12:53:52.720687 21348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:52.722070 21348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:52.723320 21348 hybrid_clock.cc:648] HybridClock initialized: now 1790254432723231 us; error 88 us; skew 500 ppm
I20260924 12:53:52.723778 21348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:53:52.727222 21348 webserver.cc:460] Webserver started at http://127.11.49.65:37501/ using document root <none> and password file <none>
I20260924 12:53:52.728183 21348 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:52.728408 21348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:52.728806 21348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:52.732829 21348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "9e7d454badaf4cdcbf24c44f5ca8a2e2"
format_stamp: "Formatted at 2026-09-24 12:53:52 on dist-test-slave-m9hg"
server_key: "2d0a5c511e66d591ff57d9c6b9683620"
server_key_iv: "ebb95643420768ab773009d8311e345e"
server_key_version: "encryptionkey@0"
I20260924 12:53:52.733939 21348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "9e7d454badaf4cdcbf24c44f5ca8a2e2"
format_stamp: "Formatted at 2026-09-24 12:53:52 on dist-test-slave-m9hg"
server_key: "2d0a5c511e66d591ff57d9c6b9683620"
server_key_iv: "ebb95643420768ab773009d8311e345e"
server_key_version: "encryptionkey@0"
I20260924 12:53:52.742467 21348 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.004s
I20260924 12:53:52.747649 21362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:52.750099 21348 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260924 12:53:52.750372 21348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "9e7d454badaf4cdcbf24c44f5ca8a2e2"
format_stamp: "Formatted at 2026-09-24 12:53:52 on dist-test-slave-m9hg"
server_key: "2d0a5c511e66d591ff57d9c6b9683620"
server_key_iv: "ebb95643420768ab773009d8311e345e"
server_key_version: "encryptionkey@0"
I20260924 12:53:52.750670 21348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:52.758839 21348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:52.760062 21348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:52.760511 21348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:52.761790 21348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:52.763775 21348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:52.763912 21348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:52.764015 21348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:52.764091 21348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:52.809192 21348 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:34701
I20260924 12:53:52.809278 21474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:34701 every 8 connection(s)
I20260924 12:53:52.811182 21348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:53:52.811921 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 21348
I20260924 12:53:52.812189 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:53:52.813073 11461 external_mini_cluster.cc:1428] Setting key 0720767b344cffbbd57df3ec93421c0a
I20260924 12:53:52.817283 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40865
--builtin_ntp_servers=127.11.49.84:34253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260924 12:53:52.822968 21477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:52.815097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:51653 (local address 127.11.49.126:40865)
0924 12:53:52.815768 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:52.815776 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:52.817626 (+ 1850us) server_negotiation.cc:407] Connection header received
0924 12:53:52.819726 (+ 2100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:52.819735 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:52.819820 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:52.819968 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:52.821906 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:52.821915 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:52.821923 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:52.821948 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:52.822010 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:52.822029 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:52.822188 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:52.822473 (+ 285us) server_negotiation.cc:299] Negotiation successful
0924 12:53:52.822545 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":324,"threads_started":1}
I20260924 12:53:52.824394 21478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:52.815882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40865 (local address 127.11.49.65:51653)
0924 12:53:52.817339 (+ 1457us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:52.817427 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:52.819338 (+ 1911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:52.820346 (+ 1008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:52.820363 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:52.820503 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:52.821479 (+ 976us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:53:52.821482 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:52.821539 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:53:52.821667 (+ 128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:52.822195 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:52.822206 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:52.822214 (+ 8us) client_negotiation.cc:769] Sending connection context
0924 12:53:52.822541 (+ 327us) client_negotiation.cc:240] Negotiation successful
0924 12:53:52.822846 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"thread_start_us":502,"threads_started":1}
I20260924 12:53:52.826896 21475 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40865
I20260924 12:53:52.827349 21475 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:52.828104 21475 heartbeater.cc:511] Master 127.11.49.126:40865 requested a full tablet report, sending...
I20260924 12:53:52.830744 21289 ts_manager.cc:194] Registered new tserver with Master: 9e7d454badaf4cdcbf24c44f5ca8a2e2 (127.11.49.65:34701)
W20260924 12:53:53.251585 21479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:53.252075 21479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:53.252336 21479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:53.261430 21479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:53.261663 21479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:53.261900 21479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:53:53.273054 21479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40865
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:53.275074 21479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:53.277835 21479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:53.296305 21484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:53.296260 21485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:53.296708 21487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:53.297976 21479 server_base.cc:1034] running on GCE node
I20260924 12:53:53.298873 21479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:53.300263 21479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:53.301679 21479 hybrid_clock.cc:648] HybridClock initialized: now 1790254433301612 us; error 48 us; skew 500 ppm
I20260924 12:53:53.302229 21479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:53:53.314339 21479 webserver.cc:460] Webserver started at http://127.11.49.66:40971/ using document root <none> and password file <none>
I20260924 12:53:53.315455 21479 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:53.315605 21479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:53.316033 21479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:53.320016 21479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "7989c1ef52c940aa98a238c333ce9835"
format_stamp: "Formatted at 2026-09-24 12:53:53 on dist-test-slave-m9hg"
server_key: "bd6bf08cca44b5476d371cec34d8ff1f"
server_key_iv: "3c7efe9d7202fe6929e8ef50d2c82b52"
server_key_version: "encryptionkey@0"
I20260924 12:53:53.321307 21479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "7989c1ef52c940aa98a238c333ce9835"
format_stamp: "Formatted at 2026-09-24 12:53:53 on dist-test-slave-m9hg"
server_key: "bd6bf08cca44b5476d371cec34d8ff1f"
server_key_iv: "3c7efe9d7202fe6929e8ef50d2c82b52"
server_key_version: "encryptionkey@0"
I20260924 12:53:53.329113 21479 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260924 12:53:53.334249 21493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:53.336596 21479 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.007s sys 0.000s
I20260924 12:53:53.336885 21479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "7989c1ef52c940aa98a238c333ce9835"
format_stamp: "Formatted at 2026-09-24 12:53:53 on dist-test-slave-m9hg"
server_key: "bd6bf08cca44b5476d371cec34d8ff1f"
server_key_iv: "3c7efe9d7202fe6929e8ef50d2c82b52"
server_key_version: "encryptionkey@0"
I20260924 12:53:53.337266 21479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:53.345274 21479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:53.346712 21479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:53.347129 21479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:53.348531 21479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:53.350502 21479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:53.350651 21479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:53.350819 21479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:53.350936 21479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:53.396808 21479 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:38429
I20260924 12:53:53.396865 21605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:38429 every 8 connection(s)
I20260924 12:53:53.398597 21479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:53:53.402710 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 21479
I20260924 12:53:53.402925 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:53:53.403388 11461 external_mini_cluster.cc:1428] Setting key 9741daa6e06e9f6d471d36c61ef2d535
I20260924 12:53:53.406915 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40865
--builtin_ntp_servers=127.11.49.84:34253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260924 12:53:53.410188 21608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:53.402021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:59905 (local address 127.11.49.126:40865)
0924 12:53:53.402638 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:53.402645 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:53.404658 (+ 2013us) server_negotiation.cc:407] Connection header received
0924 12:53:53.406990 (+ 2332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:53.406995 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:53.407118 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:53.407317 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:53.409092 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:53.409098 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:53.409102 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:53.409122 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:53.409180 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:53.409194 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:53.409394 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:53.409730 (+ 336us) server_negotiation.cc:299] Negotiation successful
0924 12:53:53.409821 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":318,"threads_started":1}
I20260924 12:53:53.411501 21609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:53.402933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40865 (local address 127.11.49.66:59905)
0924 12:53:53.404456 (+ 1523us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:53.404529 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:53.406623 (+ 2094us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:53.407601 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:53.407615 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:53.407763 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:53.408655 (+ 892us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:53:53.408661 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:53.408717 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:53:53.408841 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:53.409447 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:53.409463 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:53.409473 (+ 10us) client_negotiation.cc:769] Sending connection context
0924 12:53:53.409865 (+ 392us) client_negotiation.cc:240] Negotiation successful
0924 12:53:53.410265 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":729,"thread_start_us":391,"threads_started":1}
I20260924 12:53:53.413420 21606 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40865
I20260924 12:53:53.413851 21606 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:53.414633 21606 heartbeater.cc:511] Master 127.11.49.126:40865 requested a full tablet report, sending...
I20260924 12:53:53.416942 21289 ts_manager.cc:194] Registered new tserver with Master: 7989c1ef52c940aa98a238c333ce9835 (127.11.49.66:38429)
W20260924 12:53:53.774444 21610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:53.774777 21610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:53.774870 21610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:53.782495 21610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:53.782637 21610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:53.782761 21610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:53:53.792675 21610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:40865
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:53.794100 21610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:53.796188 21610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:53.813933 21618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:53.813970 21615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:53.814174 21616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:53.814541 21610 server_base.cc:1034] running on GCE node
I20260924 12:53:53.815944 21610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:53.817257 21610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:53.818513 21610 hybrid_clock.cc:648] HybridClock initialized: now 1790254433818423 us; error 97 us; skew 500 ppm
I20260924 12:53:53.818917 21610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:53:53.821882 21610 webserver.cc:460] Webserver started at http://127.11.49.67:39955/ using document root <none> and password file <none>
I20260924 12:53:53.822688 21610 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:53.822793 21610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:53.823135 21610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:53.826809 21610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "adec97fce8e94d35b8464d5e7f46ff3b"
format_stamp: "Formatted at 2026-09-24 12:53:53 on dist-test-slave-m9hg"
server_key: "d67027f16a3b7eeb2a66edab8ec999fc"
server_key_iv: "bb2cc8437b7d240f66ef9fc6bb6ce018"
server_key_version: "encryptionkey@0"
I20260924 12:53:53.827937 21610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "adec97fce8e94d35b8464d5e7f46ff3b"
format_stamp: "Formatted at 2026-09-24 12:53:53 on dist-test-slave-m9hg"
server_key: "d67027f16a3b7eeb2a66edab8ec999fc"
server_key_iv: "bb2cc8437b7d240f66ef9fc6bb6ce018"
server_key_version: "encryptionkey@0"
I20260924 12:53:53.834666 21475 heartbeater.cc:503] Master 127.11.49.126:40865 was elected leader, sending a full tablet report...
I20260924 12:53:53.834697 21610 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260924 12:53:53.839999 21624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:53.842331 21610 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260924 12:53:53.842592 21610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "adec97fce8e94d35b8464d5e7f46ff3b"
format_stamp: "Formatted at 2026-09-24 12:53:53 on dist-test-slave-m9hg"
server_key: "d67027f16a3b7eeb2a66edab8ec999fc"
server_key_iv: "bb2cc8437b7d240f66ef9fc6bb6ce018"
server_key_version: "encryptionkey@0"
I20260924 12:53:53.842952 21610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:53.849922 21610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:53.850872 21610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:53.851182 21610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:53.852368 21610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:53.854090 21610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:53.854223 21610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:53.854369 21610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:53.854467 21610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:53.896234 21610 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:40061
I20260924 12:53:53.896435 21736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:40061 every 8 connection(s)
I20260924 12:53:53.897729 21610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:53:53.907142 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 21610
I20260924 12:53:53.907383 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:53:53.907814 11461 external_mini_cluster.cc:1428] Setting key fc5a0ddb401154c1004cc781a4e3b3d6
I20260924 12:53:53.908972 21608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:53.901453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:41535 (local address 127.11.49.126:40865)
0924 12:53:53.901725 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:53.901731 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:53.903597 (+ 1866us) server_negotiation.cc:407] Connection header received
0924 12:53:53.905819 (+ 2222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:53.905826 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:53.905934 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:53.906073 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:53.907893 (+ 1820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:53.907900 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:53.907908 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:53.907934 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:53.907984 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:53.908004 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:53.908164 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:53.908538 (+ 374us) server_negotiation.cc:299] Negotiation successful
0924 12:53:53.908628 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260924 12:53:53.910641 21739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:53.902000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:40865 (local address 127.11.49.67:41535)
0924 12:53:53.903375 (+ 1375us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:53.903427 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:53.905429 (+ 2002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:53.906400 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:53.906411 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:53.906543 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:53.907453 (+ 910us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:53:53.907455 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:53.907546 (+ 91us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:53:53.907678 (+ 132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:53.908119 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:53.908130 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:53.908139 (+ 9us) client_negotiation.cc:769] Sending connection context
0924 12:53:53.908591 (+ 452us) client_negotiation.cc:240] Negotiation successful
0924 12:53:53.908993 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":370,"threads_started":1}
I20260924 12:53:53.912514 21737 heartbeater.cc:347] Connected to a master server at 127.11.49.126:40865
I20260924 12:53:53.913053 21737 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:53.914021 21737 heartbeater.cc:511] Master 127.11.49.126:40865 requested a full tablet report, sending...
I20260924 12:53:53.916152 21289 ts_manager.cc:194] Registered new tserver with Master: adec97fce8e94d35b8464d5e7f46ff3b (127.11.49.67:40061)
I20260924 12:53:53.926326 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260924 12:53:53.934995 21608 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:53:53.932513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46860 (local address 127.11.49.126:40865)
0924 12:53:53.932847 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:53.932855 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:53.933659 (+ 804us) server_negotiation.cc:407] Connection header received
0924 12:53:53.933928 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:53.933935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:53.934017 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:53.934156 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:53.934620 (+ 464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46860: BlockingRecv error: recv got EOF from 127.0.0.1:46860 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
I20260924 12:53:53.935781 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 21348
I20260924 12:53:53.941319 21746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:53.937743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45278 (local address 127.11.49.65:34701)
0924 12:53:53.938493 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:53.938503 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:53.938541 (+ 38us) server_negotiation.cc:407] Connection header received
0924 12:53:53.938633 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:53.938640 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:53.938937 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:53.939112 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:53.940429 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:53.940437 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:53.940454 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:53.940469 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:53.940522 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:53.940538 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:53.940707 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:53.940763 (+ 56us) server_negotiation.cc:299] Negotiation successful
0924 12:53:53.940914 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":308,"threads_started":1}
I20260924 12:53:53.943146 21470 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:54.030529 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 21348
I20260924 12:53:54.050108 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 21479
I20260924 12:53:54.054574 21748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:54.051295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58638 (local address 127.11.49.66:38429)
0924 12:53:54.051963 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:54.051971 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:54.052007 (+ 36us) server_negotiation.cc:407] Connection header received
0924 12:53:54.052109 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:54.052116 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:54.052437 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:54.052586 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:54.053762 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:54.053769 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:54.053782 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:54.053806 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:54.053860 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:54.053877 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:54.054017 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:54.054228 (+ 211us) server_negotiation.cc:299] Negotiation successful
0924 12:53:54.054315 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":351,"threads_started":1}
I20260924 12:53:54.056231 21601 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:54.147702 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 21479
I20260924 12:53:54.168825 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 21610
I20260924 12:53:54.173579 21750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:54.170023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47814 (local address 127.11.49.67:40061)
0924 12:53:54.170856 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:54.170865 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:54.170947 (+ 82us) server_negotiation.cc:407] Connection header received
0924 12:53:54.171043 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:54.171051 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:54.171342 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:54.171550 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:54.172788 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:54.172795 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:54.172810 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:53:54.172830 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:54.172887 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:53:54.172903 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:54.173074 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:54.173134 (+ 60us) server_negotiation.cc:299] Negotiation successful
0924 12:53:54.173238 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":425,"threads_started":1}
I20260924 12:53:54.175055 21732 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:54.262982 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 21610
I20260924 12:53:54.280920 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 21258
I20260924 12:53:54.282302 21319 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:54.390497 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 21258
2026-09-24T12:53:54Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2962 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:53:54 dist-test-slave-m9hg krb5kdc[21755](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:53:54 dist-test-slave-m9hg krb5kdc[21755](info): set up 2 sockets
Sep 24 12:53:54 dist-test-slave-m9hg krb5kdc[21755](info): commencing operation
krb5kdc: starting...
W20260924 12:53:55.578559 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:53:55 dist-test-slave-m9hg krb5kdc[21755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:53:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:53:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:53:55.897781 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:44883
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:44883
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:56.357872 21768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:56.358338 21768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:56.358522 21768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:56.367518 21768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:53:56.367754 21768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:56.367929 21768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:56.368052 21768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:53:56.368130 21768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:53:56.380159 21768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:44883
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:44883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:56.382110 21768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:56.383941 21768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:56.400857 21774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:56.401042 21773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:56.401000 21776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:56.402488 21768 server_base.cc:1034] running on GCE node
I20260924 12:53:56.403833 21768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:56.406335 21768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:56.407672 21768 hybrid_clock.cc:648] HybridClock initialized: now 1790254436407562 us; error 91 us; skew 500 ppm
I20260924 12:53:56.408461 21768 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:56 dist-test-slave-m9hg krb5kdc[21755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254436, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:56.413551 21768 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:53:56.415999 21768 webserver.cc:460] Webserver started at http://127.11.49.126:40709/ using document root <none> and password file <none>
I20260924 12:53:56.417094 21768 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:56.417237 21768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:56.417670 21768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:56.422479 21768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "d9088aab62eb42438b5b497380d195c4"
format_stamp: "Formatted at 2026-09-24 12:53:56 on dist-test-slave-m9hg"
server_key: "cfb369057b92d6c8a0b864044aefa1ec"
server_key_iv: "49d5a0a6138d937425c0f092747785c9"
server_key_version: "encryptionkey@0"
I20260924 12:53:56.423695 21768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "d9088aab62eb42438b5b497380d195c4"
format_stamp: "Formatted at 2026-09-24 12:53:56 on dist-test-slave-m9hg"
server_key: "cfb369057b92d6c8a0b864044aefa1ec"
server_key_iv: "49d5a0a6138d937425c0f092747785c9"
server_key_version: "encryptionkey@0"
I20260924 12:53:56.431648 21768 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.004s
I20260924 12:53:56.437567 21783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:56.439754 21768 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.002s
I20260924 12:53:56.439996 21768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "d9088aab62eb42438b5b497380d195c4"
format_stamp: "Formatted at 2026-09-24 12:53:56 on dist-test-slave-m9hg"
server_key: "cfb369057b92d6c8a0b864044aefa1ec"
server_key_iv: "49d5a0a6138d937425c0f092747785c9"
server_key_version: "encryptionkey@0"
I20260924 12:53:56.440259 21768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:56.462394 21768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:56.469004 21768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:56.469365 21768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:56.496471 21834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:44883 every 8 connection(s)
I20260924 12:53:56.496482 21768 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:44883
I20260924 12:53:56.498399 21768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:53:56.501087 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 21768
I20260924 12:53:56.501405 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:53:56.502142 11461 external_mini_cluster.cc:1428] Setting key e599432f51b8fce28a924e2e60c58bc6
I20260924 12:53:56.503142 21835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:56.517858 21835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4: Bootstrap starting.
Sep 24 12:53:56 dist-test-slave-m9hg krb5kdc[21755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:56.522091 21835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:56.523265 21835 log.cc:824] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:56.526746 21835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4: No bootstrap required, opened a new log
I20260924 12:53:56.533557 21838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:56.505242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34988 (local address 127.11.49.126:44883)
0924 12:53:56.506324 (+ 1082us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:56.506341 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:56.506405 (+ 64us) server_negotiation.cc:407] Connection header received
0924 12:53:56.508687 (+ 2282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:56.508722 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:56.509392 (+ 670us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:56.509939 (+ 547us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:56.511919 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:56.513592 (+ 1673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:56.515516 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:56.516657 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:56.516932 (+ 275us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:56.523295 (+ 6363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:56.523307 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:56.523330 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:56.523411 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:56.527590 (+ 4179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:56.528770 (+ 1180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:56.528785 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:56.528795 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:56.529058 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:56.529579 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:56.529587 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:56.529589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:56.530392 (+ 803us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:56.530799 (+ 407us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:56.531392 (+ 593us) server_negotiation.cc:299] Negotiation successful
0924 12:53:56.531979 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":771,"thread_start_us":458,"threads_started":1}
I20260924 12:53:56.535748 21835 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9088aab62eb42438b5b497380d195c4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44883 } }
I20260924 12:53:56.536201 21835 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:56.536369 21835 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9088aab62eb42438b5b497380d195c4, State: Initialized, Role: FOLLOWER
I20260924 12:53:56.537120 21835 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9088aab62eb42438b5b497380d195c4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44883 } }
I20260924 12:53:56.537379 21835 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:53:56.537555 21835 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:53:56.537777 21835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:56.540064 21835 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9088aab62eb42438b5b497380d195c4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44883 } }
I20260924 12:53:56.540743 21835 leader_election.cc:302] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9088aab62eb42438b5b497380d195c4; no voters:
I20260924 12:53:56.541456 21835 leader_election.cc:288] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:53:56.541798 21840 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:56.543072 21840 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [term 1 LEADER]: Becoming Leader. State: Replica: d9088aab62eb42438b5b497380d195c4, State: Running, Role: LEADER
I20260924 12:53:56.543973 21835 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:53:56.543943 21840 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9088aab62eb42438b5b497380d195c4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44883 } }
I20260924 12:53:56.548774 21841 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9088aab62eb42438b5b497380d195c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9088aab62eb42438b5b497380d195c4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44883 } } }
I20260924 12:53:56.549274 21841 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:56.548295 21842 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9088aab62eb42438b5b497380d195c4. Latest consensus state: current_term: 1 leader_uuid: "d9088aab62eb42438b5b497380d195c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9088aab62eb42438b5b497380d195c4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44883 } } }
I20260924 12:53:56.552176 21842 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4 [sys.catalog]: This master's current role is: LEADER
I20260924 12:53:56.553560 21849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:53:56.560524 21849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:53:56.573657 21849 catalog_manager.cc:1347] Generated new cluster ID: f77d528b1cf447a9a2747ba3593396f7
I20260924 12:53:56.573827 21849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:53:56.593969 21849 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:53:56.596607 21849 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:53:56.613246 21849 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4: Generated new TSK 0
I20260924 12:53:56.614579 21849 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:53:56.697886 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:44883
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:57.185084 21861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:57.185498 21861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:57.185614 21861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:57.194625 21861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:57.194902 21861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:57.195128 21861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:53:57.207610 21861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:44883
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:57.209604 21861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:57.211467 21861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:57.233063 21866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:57.233063 21867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:57.233137 21869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:57.234028 21861 server_base.cc:1034] running on GCE node
I20260924 12:53:57.234915 21861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:57.236537 21861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:57.240121 21861 hybrid_clock.cc:648] HybridClock initialized: now 1790254437239922 us; error 249 us; skew 500 ppm
I20260924 12:53:57.240764 21861 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:57 dist-test-slave-m9hg krb5kdc[21755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254437, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:57.246982 21861 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:53:57.249634 21861 webserver.cc:460] Webserver started at http://127.11.49.65:41357/ using document root <none> and password file <none>
I20260924 12:53:57.250559 21861 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:57.250738 21861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:57.251297 21861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:57.255206 21861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "00d22cdad0eb4b4e8cebe367bc272a45"
format_stamp: "Formatted at 2026-09-24 12:53:57 on dist-test-slave-m9hg"
server_key: "fbe36db585e9619f2ba09019107ee23c"
server_key_iv: "a54862d6a84845d9bbd14a90d905a717"
server_key_version: "encryptionkey@0"
I20260924 12:53:57.257100 21861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "00d22cdad0eb4b4e8cebe367bc272a45"
format_stamp: "Formatted at 2026-09-24 12:53:57 on dist-test-slave-m9hg"
server_key: "fbe36db585e9619f2ba09019107ee23c"
server_key_iv: "a54862d6a84845d9bbd14a90d905a717"
server_key_version: "encryptionkey@0"
I20260924 12:53:57.265534 21861 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.002s sys 0.005s
I20260924 12:53:57.271065 21876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:57.273671 21861 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260924 12:53:57.274037 21861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "00d22cdad0eb4b4e8cebe367bc272a45"
format_stamp: "Formatted at 2026-09-24 12:53:57 on dist-test-slave-m9hg"
server_key: "fbe36db585e9619f2ba09019107ee23c"
server_key_iv: "a54862d6a84845d9bbd14a90d905a717"
server_key_version: "encryptionkey@0"
I20260924 12:53:57.274313 21861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:57.303331 21861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:57.308636 21861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:57.309067 21861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:57.310236 21861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:57.312005 21861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:57.312124 21861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:57.312347 21861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:57.312436 21861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260924 12:53:57.357860 21861 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:45983
I20260924 12:53:57.358050 21988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:45983 every 8 connection(s)
I20260924 12:53:57.359922 21861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:53:57.367844 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 21861
I20260924 12:53:57.368126 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:53:57.368876 11461 external_mini_cluster.cc:1428] Setting key d1c9479fafc34bb5018aba333a54c816
Sep 24 12:53:57 dist-test-slave-m9hg krb5kdc[21755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254437, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:57.390807 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:57.363800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:38461 (local address 127.11.49.126:44883)
0924 12:53:57.364444 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:57.364450 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:57.365554 (+ 1104us) server_negotiation.cc:407] Connection header received
0924 12:53:57.368063 (+ 2509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:57.368070 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:57.368259 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:57.368425 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:57.371020 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:57.371896 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:57.375411 (+ 3515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:57.375959 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:57.376108 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:57.382121 (+ 6013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:57.382127 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:57.382131 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:57.382171 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:57.386222 (+ 4051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:57.387529 (+ 1307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:57.387538 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:57.387544 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:57.387725 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:57.388262 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:57.388302 (+ 40us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:57.388308 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:57.388704 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:57.388889 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:57.389976 (+ 1087us) server_negotiation.cc:299] Negotiation successful
0924 12:53:57.390323 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":325,"threads_started":1}
I20260924 12:53:57.391934 21992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:57.364153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:44883 (local address 127.11.49.65:38461)
0924 12:53:57.365310 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:57.365367 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:57.367599 (+ 2232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:57.368791 (+ 1192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:57.368803 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:57.369592 (+ 789us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:57.370649 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:57.370684 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:57.372212 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:57.372218 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:57.375070 (+ 2852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:57.375110 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:57.376364 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:57.376376 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:57.376826 (+ 450us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:57.377961 (+ 1135us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:57.378009 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:57.381753 (+ 3744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:57.386537 (+ 4784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:57.386554 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:57.386578 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:57.387302 (+ 724us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:57.387858 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:57.387862 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:57.387864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:57.388117 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:57.388909 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:57.388918 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:57.389447 (+ 529us) client_negotiation.cc:769] Sending connection context
0924 12:53:57.389772 (+ 325us) client_negotiation.cc:240] Negotiation successful
0924 12:53:57.390344 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"thread_start_us":437,"threads_started":1}
I20260924 12:53:57.394412 21989 heartbeater.cc:347] Connected to a master server at 127.11.49.126:44883
I20260924 12:53:57.394877 21989 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:57.395977 21989 heartbeater.cc:511] Master 127.11.49.126:44883 requested a full tablet report, sending...
I20260924 12:53:57.399166 21800 ts_manager.cc:194] Registered new tserver with Master: 00d22cdad0eb4b4e8cebe367bc272a45 (127.11.49.65:45983)
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:53:57.401194 21800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:38461
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:53:57.438340 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:44883
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:53:57.937764 21995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:57.938221 21995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:57.938470 21995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:57.947439 21995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:57.947633 21995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:57.947839 21995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:53:57.961736 21995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:44883
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:57.963943 21995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:57.966508 21995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:57.986393 22000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:57.986918 22003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:57.987052 22001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:57.989252 21995 server_base.cc:1034] running on GCE node
I20260924 12:53:57.990266 21995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:57.991879 21995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:57.993387 21995 hybrid_clock.cc:648] HybridClock initialized: now 1790254437993279 us; error 115 us; skew 500 ppm
I20260924 12:53:57.993860 21995 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:57 dist-test-slave-m9hg krb5kdc[21755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254437, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:57.999039 21995 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:53:58.001572 21995 webserver.cc:460] Webserver started at http://127.11.49.66:44209/ using document root <none> and password file <none>
I20260924 12:53:58.002609 21995 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:58.002754 21995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:58.003080 21995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:58.008764 21995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "62e94ed45cc54676a376663b6459874a"
format_stamp: "Formatted at 2026-09-24 12:53:58 on dist-test-slave-m9hg"
server_key: "1069120086e1214ad06978d2cb7fb72f"
server_key_iv: "463f86ceac3321c83a91a475a53949e7"
server_key_version: "encryptionkey@0"
I20260924 12:53:58.010301 21995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "62e94ed45cc54676a376663b6459874a"
format_stamp: "Formatted at 2026-09-24 12:53:58 on dist-test-slave-m9hg"
server_key: "1069120086e1214ad06978d2cb7fb72f"
server_key_iv: "463f86ceac3321c83a91a475a53949e7"
server_key_version: "encryptionkey@0"
I20260924 12:53:58.019114 21995 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.004s
I20260924 12:53:58.024673 22010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:58.027225 21995 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260924 12:53:58.027532 21995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "62e94ed45cc54676a376663b6459874a"
format_stamp: "Formatted at 2026-09-24 12:53:58 on dist-test-slave-m9hg"
server_key: "1069120086e1214ad06978d2cb7fb72f"
server_key_iv: "463f86ceac3321c83a91a475a53949e7"
server_key_version: "encryptionkey@0"
I20260924 12:53:58.027807 21995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:58.056653 21995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:58.063361 21995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:58.064217 21995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:58.066052 21995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:58.068195 21995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:58.068382 21995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260924 12:53:58.068606 21995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:58.068688 21995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:58.116950 21995 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:45559
I20260924 12:53:58.116984 22122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:45559 every 8 connection(s)
I20260924 12:53:58.119027 21995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:53:58.126454 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 21995
I20260924 12:53:58.126760 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:53:58.127487 11461 external_mini_cluster.cc:1428] Setting key 3a43382aaccb0b60fa4352f8e1559d05
Sep 24 12:53:58 dist-test-slave-m9hg krb5kdc[21755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254437, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:58.148013 22125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:58.122671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:44715 (local address 127.11.49.126:44883)
0924 12:53:58.123385 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:58.123396 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:58.124213 (+ 817us) server_negotiation.cc:407] Connection header received
0924 12:53:58.127071 (+ 2858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:58.127081 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:58.127248 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:58.127471 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:58.129703 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.130660 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.132783 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.133292 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.133443 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:58.138869 (+ 5426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:58.138879 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:58.138887 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:58.138939 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:58.142599 (+ 3660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:58.144245 (+ 1646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:58.144254 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:58.144261 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:58.144477 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:58.145304 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:58.145312 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:58.145319 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:58.145796 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:58.145953 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:58.147227 (+ 1274us) server_negotiation.cc:299] Negotiation successful
0924 12:53:58.147520 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":362,"threads_started":1}
I20260924 12:53:58.149453 22126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:58.123034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:44883 (local address 127.11.49.66:44715)
0924 12:53:58.123956 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:58.124006 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:58.126485 (+ 2479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:58.127872 (+ 1387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:58.127883 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:58.128749 (+ 866us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:58.129486 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:58.129508 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.130877 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.130881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:58.132571 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:58.132588 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.133550 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.133558 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:58.133917 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:58.134747 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:58.134774 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:58.138401 (+ 3627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:58.142927 (+ 4526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:58.142948 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:58.142980 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:58.143970 (+ 990us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:58.144688 (+ 718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:58.144694 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:58.144697 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:58.145128 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:58.145983 (+ 855us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:58.145993 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:58.146687 (+ 694us) client_negotiation.cc:769] Sending connection context
0924 12:53:58.147040 (+ 353us) client_negotiation.cc:240] Negotiation successful
0924 12:53:58.147712 (+ 672us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":387,"threads_started":1}
I20260924 12:53:58.151693 22123 heartbeater.cc:347] Connected to a master server at 127.11.49.126:44883
I20260924 12:53:58.152165 22123 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:58.153259 22123 heartbeater.cc:511] Master 127.11.49.126:44883 requested a full tablet report, sending...
I20260924 12:53:58.155563 21800 ts_manager.cc:194] Registered new tserver with Master: 62e94ed45cc54676a376663b6459874a (127.11.49.66:45559)
I20260924 12:53:58.156792 21800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:44715
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:53:58.199625 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:44883
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:53:58.405979 21989 heartbeater.cc:503] Master 127.11.49.126:44883 was elected leader, sending a full tablet report...
W20260924 12:53:58.573905 22129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:53:58.574331 22129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:53:58.574515 22129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:53:58.585125 22129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:53:58.585332 22129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:53:58.585548 22129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:53:58.602454 22129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:44883
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:53:58.604534 22129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:53:58.606448 22129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:53:58.627516 22134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:58.627487 22135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:53:58.627619 22137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:53:58.628965 22129 server_base.cc:1034] running on GCE node
I20260924 12:53:58.629805 22129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:53:58.631224 22129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:53:58.632471 22129 hybrid_clock.cc:648] HybridClock initialized: now 1790254438632360 us; error 103 us; skew 500 ppm
I20260924 12:53:58.632974 22129 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:53:58 dist-test-slave-m9hg krb5kdc[21755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254438, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:53:58.643695 22129 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:53:58.646597 22129 webserver.cc:460] Webserver started at http://127.11.49.67:45265/ using document root <none> and password file <none>
I20260924 12:53:58.647783 22129 fs_manager.cc:359] Metadata directory not provided
I20260924 12:53:58.648025 22129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:53:58.648613 22129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:53:58.653190 22129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "1677b76bb7e749118d99173e16358f82"
format_stamp: "Formatted at 2026-09-24 12:53:58 on dist-test-slave-m9hg"
server_key: "55a9206d74cfe84b48946eba82bb1975"
server_key_iv: "e81c7373323676a52155c27ac5205e75"
server_key_version: "encryptionkey@0"
I20260924 12:53:58.654516 22129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "1677b76bb7e749118d99173e16358f82"
format_stamp: "Formatted at 2026-09-24 12:53:58 on dist-test-slave-m9hg"
server_key: "55a9206d74cfe84b48946eba82bb1975"
server_key_iv: "e81c7373323676a52155c27ac5205e75"
server_key_version: "encryptionkey@0"
I20260924 12:53:58.662730 22129 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.000s sys 0.008s
I20260924 12:53:58.667608 22144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:58.669986 22129 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.002s
I20260924 12:53:58.670300 22129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "1677b76bb7e749118d99173e16358f82"
format_stamp: "Formatted at 2026-09-24 12:53:58 on dist-test-slave-m9hg"
server_key: "55a9206d74cfe84b48946eba82bb1975"
server_key_iv: "e81c7373323676a52155c27ac5205e75"
server_key_version: "encryptionkey@0"
I20260924 12:53:58.670588 22129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:53:58.687028 22129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:53:58.693737 22129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:53:58.694232 22129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:53:58.695755 22129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:53:58.698163 22129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:53:58.698267 22129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:58.698654 22129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:53:58.698786 22129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:53:58.745949 22129 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:36255
I20260924 12:53:58.746042 22256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:36255 every 8 connection(s)
I20260924 12:53:58.747874 22129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:53:58.751426 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 22129
I20260924 12:53:58.751705 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:53:58.752413 11461 external_mini_cluster.cc:1428] Setting key 7f830a475ee5c26162be4490a891335f
Sep 24 12:53:58 dist-test-slave-m9hg krb5kdc[21755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254438, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:53:58.777132 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:58.751860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:33153 (local address 127.11.49.126:44883)
0924 12:53:58.752570 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:58.752578 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:58.754211 (+ 1633us) server_negotiation.cc:407] Connection header received
0924 12:53:58.756571 (+ 2360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:58.756575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:58.756718 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:58.756844 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:58.759131 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.760005 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.762624 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.763059 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.763183 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:58.769097 (+ 5914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:58.769104 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:58.769110 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:58.769161 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:58.772400 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:58.773599 (+ 1199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:58.773612 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:58.773615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:58.773759 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:58.774521 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:58.774526 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:58.774529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:58.774922 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:58.775057 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:58.776568 (+ 1511us) server_negotiation.cc:299] Negotiation successful
0924 12:53:58.776829 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":319,"threads_started":1}
I20260924 12:53:58.779235 22260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:58.752778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:44883 (local address 127.11.49.67:33153)
0924 12:53:58.753972 (+ 1194us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:58.754033 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:58.756126 (+ 2093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:58.757295 (+ 1169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:58.757306 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:58.758001 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:53:58.758814 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:58.758860 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.760402 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.760410 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:58.762371 (+ 1961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:58.762399 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.763386 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.763394 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:58.763700 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:58.764768 (+ 1068us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:53:58.764800 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:53:58.768566 (+ 3766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:53:58.772645 (+ 4079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:58.772657 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:58.772677 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:58.773407 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:58.773929 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:53:58.773933 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:53:58.773936 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:53:58.774259 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:53:58.775094 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:53:58.775102 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:53:58.776038 (+ 936us) client_negotiation.cc:769] Sending connection context
0924 12:53:58.776425 (+ 387us) client_negotiation.cc:240] Negotiation successful
0924 12:53:58.776987 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"thread_start_us":477,"threads_started":1}
I20260924 12:53:58.781893 22257 heartbeater.cc:347] Connected to a master server at 127.11.49.126:44883
I20260924 12:53:58.782382 22257 heartbeater.cc:464] Registering TS with master...
I20260924 12:53:58.783324 22257 heartbeater.cc:511] Master 127.11.49.126:44883 requested a full tablet report, sending...
I20260924 12:53:58.785331 21800 ts_manager.cc:194] Registered new tserver with Master: 1677b76bb7e749118d99173e16358f82 (127.11.49.67:36255)
I20260924 12:53:58.786465 21800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:33153
I20260924 12:53:58.796914 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:53:58.816764 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:58.802409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34992 (local address 127.11.49.126:44883)
0924 12:53:58.802681 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:58.802690 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:58.803213 (+ 523us) server_negotiation.cc:407] Connection header received
0924 12:53:58.803438 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:58.803446 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:58.803519 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:58.803631 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:58.805199 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.805945 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.807257 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.807687 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.807826 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:58.810698 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:58.810704 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:58.810708 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:58.810749 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:58.813848 (+ 3099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:58.814639 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:58.814645 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:58.814648 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:58.814789 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:58.815164 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:58.815169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:58.815172 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:58.815508 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:58.815803 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:58.816152 (+ 349us) server_negotiation.cc:299] Negotiation successful
0924 12:53:58.816434 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260924 12:53:58.822609 21800 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34992:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:53:58.831496 21800 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:53:58.888082 22271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:58.854265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:45559 (local address 127.0.0.1:36128)
0924 12:53:58.875917 (+ 21652us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:58.875940 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:58.876108 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:58.877431 (+ 1323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:58.877453 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:58.877501 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:58.878381 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:58.878399 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.881025 (+ 2626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.881033 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:58.883762 (+ 2729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:58.883790 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.886372 (+ 2582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.886381 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:58.886621 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:58.886688 (+ 67us) client_negotiation.cc:769] Sending connection context
0924 12:53:58.886975 (+ 287us) client_negotiation.cc:240] Negotiation successful
0924 12:53:58.887370 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21522,"mutex_wait_us":102,"thread_start_us":18742,"threads_started":1}
I20260924 12:53:58.888041 22274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:58.853197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36128 (local address 127.11.49.66:45559)
0924 12:53:58.874558 (+ 21361us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:58.874572 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:58.876300 (+ 1728us) server_negotiation.cc:407] Connection header received
0924 12:53:58.876459 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:58.876469 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:58.876798 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:58.877237 (+ 439us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:58.878814 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.880804 (+ 1990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.884112 (+ 3308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.885856 (+ 1744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.886302 (+ 446us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:58.886558 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:58.887021 (+ 463us) server_negotiation.cc:299] Negotiation successful
0924 12:53:58.887368 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21092,"thread_start_us":20909,"threads_started":1}
I20260924 12:53:58.889812 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:58.852091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:36255 (local address 127.0.0.1:44102)
0924 12:53:58.873546 (+ 21455us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:58.873582 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:58.873833 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:58.877695 (+ 3862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:58.877699 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:58.877731 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:58.878667 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:58.878689 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.880943 (+ 2254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.880949 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:58.884507 (+ 3558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:58.884538 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.888443 (+ 3905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.888449 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:58.888772 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:58.888886 (+ 114us) client_negotiation.cc:769] Sending connection context
0924 12:53:58.889030 (+ 144us) client_negotiation.cc:240] Negotiation successful
0924 12:53:58.889259 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21204,"mutex_wait_us":444,"spinlock_wait_cycles":7936,"thread_start_us":23533,"threads_started":1}
I20260924 12:53:58.889905 22272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:58.852343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35374 (local address 127.11.49.65:45983)
0924 12:53:58.876860 (+ 24517us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:58.876872 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:58.876916 (+ 44us) server_negotiation.cc:407] Connection header received
0924 12:53:58.877068 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:58.877075 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:58.877545 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:58.877875 (+ 330us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:58.878971 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.880900 (+ 1929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.884853 (+ 3953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.887524 (+ 2671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.887766 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:58.888100 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:58.889241 (+ 1141us) server_negotiation.cc:299] Negotiation successful
0924 12:53:58.889494 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24298,"thread_start_us":24039,"threads_started":1}
I20260924 12:53:58.890764 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:58.851859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45983 (local address 127.0.0.1:35374)
0924 12:53:58.868870 (+ 17011us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:58.868968 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:58.869347 (+ 379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:58.877855 (+ 8508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:58.877860 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:58.877883 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:58.878707 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:58.878719 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.881092 (+ 2373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.881102 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:58.884500 (+ 3398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:58.884532 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.888434 (+ 3902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.888444 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:58.888867 (+ 423us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:58.888899 (+ 32us) client_negotiation.cc:769] Sending connection context
0924 12:53:58.889030 (+ 131us) client_negotiation.cc:240] Negotiation successful
0924 12:53:58.890292 (+ 1262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16514,"mutex_wait_us":1374,"thread_start_us":16185,"threads_started":1}
I20260924 12:53:58.891009 22273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:58.852856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44102 (local address 127.11.49.67:36255)
0924 12:53:58.876645 (+ 23789us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:58.876664 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:58.876700 (+ 36us) server_negotiation.cc:407] Connection header received
0924 12:53:58.876851 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:58.876890 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:58.877219 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:58.877401 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:58.878935 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.880742 (+ 1807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.884836 (+ 4094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:58.887524 (+ 2688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:58.887766 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:58.888101 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:58.890243 (+ 2142us) server_negotiation.cc:299] Negotiation successful
0924 12:53:58.890546 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23609,"thread_start_us":23894,"threads_started":1}
I20260924 12:53:58.893990 22058 tablet_service.cc:1467] Processing CreateTablet for tablet fa068adf50f14c31adc9b7fe3cc5c5db (DEFAULT_TABLE table=test-table [id=f33397fd0727401f86b3dffe8eca790d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:58.896039 22058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa068adf50f14c31adc9b7fe3cc5c5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:58.896111 21924 tablet_service.cc:1467] Processing CreateTablet for tablet fa068adf50f14c31adc9b7fe3cc5c5db (DEFAULT_TABLE table=test-table [id=f33397fd0727401f86b3dffe8eca790d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:58.896224 22192 tablet_service.cc:1467] Processing CreateTablet for tablet fa068adf50f14c31adc9b7fe3cc5c5db (DEFAULT_TABLE table=test-table [id=f33397fd0727401f86b3dffe8eca790d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:53:58.898350 21924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa068adf50f14c31adc9b7fe3cc5c5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:58.900004 22192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa068adf50f14c31adc9b7fe3cc5c5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:53:58.913405 22276 tablet_bootstrap.cc:492] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: Bootstrap starting.
I20260924 12:53:58.915498 22277 tablet_bootstrap.cc:492] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: Bootstrap starting.
I20260924 12:53:58.919799 22276 tablet_bootstrap.cc:654] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:58.919868 22277 tablet_bootstrap.cc:654] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:58.920395 22278 tablet_bootstrap.cc:492] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: Bootstrap starting.
I20260924 12:53:58.921368 22277 log.cc:824] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:58.922039 22276 log.cc:824] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:58.924834 22277 tablet_bootstrap.cc:492] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: No bootstrap required, opened a new log
I20260924 12:53:58.925175 22277 ts_tablet_manager.cc:1397] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20260924 12:53:58.926689 22278 tablet_bootstrap.cc:654] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: Neither blocks nor log segments found. Creating new log.
I20260924 12:53:58.927855 22276 tablet_bootstrap.cc:492] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: No bootstrap required, opened a new log
I20260924 12:53:58.928191 22276 ts_tablet_manager.cc:1397] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.006s
I20260924 12:53:58.928711 22278 log.cc:824] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: Log is configured to *not* fsync() on all Append() calls
I20260924 12:53:58.933691 22278 tablet_bootstrap.cc:492] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: No bootstrap required, opened a new log
I20260924 12:53:58.934186 22278 ts_tablet_manager.cc:1397] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.005s
I20260924 12:53:58.936997 22277 raft_consensus.cc:348] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45983 } } peers { permanent_uuid: "1677b76bb7e749118d99173e16358f82" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 36255 } } peers { permanent_uuid: "62e94ed45cc54676a376663b6459874a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45559 } }
I20260924 12:53:58.937605 22277 raft_consensus.cc:374] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:58.937724 22277 raft_consensus.cc:729] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00d22cdad0eb4b4e8cebe367bc272a45, State: Initialized, Role: FOLLOWER
I20260924 12:53:58.938678 22277 consensus_queue.cc:260] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45983 } } peers { permanent_uuid: "1677b76bb7e749118d99173e16358f82" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 36255 } } peers { permanent_uuid: "62e94ed45cc54676a376663b6459874a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45559 } }
I20260924 12:53:58.940539 22276 raft_consensus.cc:348] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45983 } } peers { permanent_uuid: "1677b76bb7e749118d99173e16358f82" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 36255 } } peers { permanent_uuid: "62e94ed45cc54676a376663b6459874a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45559 } }
I20260924 12:53:58.941253 22276 raft_consensus.cc:374] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:58.941430 22276 raft_consensus.cc:729] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62e94ed45cc54676a376663b6459874a, State: Initialized, Role: FOLLOWER
I20260924 12:53:58.942317 22276 consensus_queue.cc:260] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45983 } } peers { permanent_uuid: "1677b76bb7e749118d99173e16358f82" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 36255 } } peers { permanent_uuid: "62e94ed45cc54676a376663b6459874a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45559 } }
I20260924 12:53:58.944242 22123 heartbeater.cc:503] Master 127.11.49.126:44883 was elected leader, sending a full tablet report...
I20260924 12:53:58.944649 22276 ts_tablet_manager.cc:1428] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: Time spent starting tablet: real 0.016s user 0.015s sys 0.001s
I20260924 12:53:58.946164 22277 ts_tablet_manager.cc:1428] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: Time spent starting tablet: real 0.021s user 0.014s sys 0.005s
I20260924 12:53:58.947956 22278 raft_consensus.cc:348] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45983 } } peers { permanent_uuid: "1677b76bb7e749118d99173e16358f82" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 36255 } } peers { permanent_uuid: "62e94ed45cc54676a376663b6459874a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45559 } }
I20260924 12:53:58.948714 22278 raft_consensus.cc:374] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:53:58.948850 22278 raft_consensus.cc:729] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1677b76bb7e749118d99173e16358f82, State: Initialized, Role: FOLLOWER
I20260924 12:53:58.949982 22278 consensus_queue.cc:260] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45983 } } peers { permanent_uuid: "1677b76bb7e749118d99173e16358f82" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 36255 } } peers { permanent_uuid: "62e94ed45cc54676a376663b6459874a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45559 } }
I20260924 12:53:58.952688 22257 heartbeater.cc:503] Master 127.11.49.126:44883 was elected leader, sending a full tablet report...
I20260924 12:53:58.953615 22278 ts_tablet_manager.cc:1428] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: Time spent starting tablet: real 0.019s user 0.013s sys 0.007s
W20260924 12:53:59.000453 22258 tablet.cc:2369] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:53:59.113888 21990 tablet.cc:2369] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:53:59.122166 22124 tablet.cc:2369] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:53:59.143805 22282 raft_consensus.cc:482] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:53:59.144098 22282 raft_consensus.cc:504] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45983 } } peers { permanent_uuid: "1677b76bb7e749118d99173e16358f82" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 36255 } } peers { permanent_uuid: "62e94ed45cc54676a376663b6459874a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45559 } }
I20260924 12:53:59.146206 22282 leader_election.cc:288] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1677b76bb7e749118d99173e16358f82 (127.11.49.67:36255), 62e94ed45cc54676a376663b6459874a (127.11.49.66:45559)
I20260924 12:53:59.157750 22273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:59.147086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:51949 (local address 127.11.49.67:36255)
0924 12:53:59.147511 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:59.147520 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:59.148169 (+ 649us) server_negotiation.cc:407] Connection header received
0924 12:53:59.148361 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:59.148368 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:59.148479 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:59.148630 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:59.149609 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.150909 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.154533 (+ 3624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.156039 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.156358 (+ 319us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:59.156457 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:59.157217 (+ 760us) server_negotiation.cc:299] Negotiation successful
0924 12:53:59.157406 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288}
I20260924 12:53:59.157750 22274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:59.147069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:49587 (local address 127.11.49.66:45559)
0924 12:53:59.147316 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:59.147324 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:59.148124 (+ 800us) server_negotiation.cc:407] Connection header received
0924 12:53:59.148361 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:59.148368 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:59.148478 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:59.148630 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:53:59.149609 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.150899 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.154533 (+ 3634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.156040 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.156368 (+ 328us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:59.156466 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:59.157217 (+ 751us) server_negotiation.cc:299] Negotiation successful
0924 12:53:59.157405 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260924 12:53:59.157940 22285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:59.146831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:45559 (local address 127.11.49.65:49587)
0924 12:53:59.147870 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:59.147904 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:59.148144 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:59.148726 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:59.148730 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:59.148838 (+ 108us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:59.149346 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:59.149366 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.151198 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.151205 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:59.154160 (+ 2955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:59.154184 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.156518 (+ 2334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.156523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:59.156829 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:59.156947 (+ 118us) client_negotiation.cc:769] Sending connection context
0924 12:53:59.157084 (+ 137us) client_negotiation.cc:240] Negotiation successful
0924 12:53:59.157339 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":829,"mutex_wait_us":370,"spinlock_wait_cycles":25344,"thread_start_us":500,"threads_started":1}
I20260924 12:53:59.157951 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:59.146970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:36255 (local address 127.11.49.65:51949)
0924 12:53:59.148061 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0924 12:53:59.148077 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0924 12:53:59.148177 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:53:59.148724 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:53:59.148730 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:53:59.148766 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:53:59.149386 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:59.149395 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.151158 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.151167 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:59.154159 (+ 2992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:53:59.154184 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.156514 (+ 2330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.156523 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:53:59.156831 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:59.156947 (+ 116us) client_negotiation.cc:769] Sending connection context
0924 12:53:59.157084 (+ 137us) client_negotiation.cc:240] Negotiation successful
0924 12:53:59.157339 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":972,"mutex_wait_us":302,"thread_start_us":749,"threads_started":1}
I20260924 12:53:59.160073 22212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa068adf50f14c31adc9b7fe3cc5c5db" candidate_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1677b76bb7e749118d99173e16358f82" is_pre_election: true
I20260924 12:53:59.160068 22078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa068adf50f14c31adc9b7fe3cc5c5db" candidate_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62e94ed45cc54676a376663b6459874a" is_pre_election: true
I20260924 12:53:59.160934 22078 raft_consensus.cc:2454] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00d22cdad0eb4b4e8cebe367bc272a45 in term 0.
I20260924 12:53:59.160935 22212 raft_consensus.cc:2454] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00d22cdad0eb4b4e8cebe367bc272a45 in term 0.
I20260924 12:53:59.162118 21880 leader_election.cc:302] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 00d22cdad0eb4b4e8cebe367bc272a45, 1677b76bb7e749118d99173e16358f82, 62e94ed45cc54676a376663b6459874a; no voters:
I20260924 12:53:59.162866 22282 raft_consensus.cc:2781] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:53:59.163115 22282 raft_consensus.cc:482] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:53:59.163254 22282 raft_consensus.cc:3037] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:59.165755 22282 raft_consensus.cc:504] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45983 } } peers { permanent_uuid: "1677b76bb7e749118d99173e16358f82" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 36255 } } peers { permanent_uuid: "62e94ed45cc54676a376663b6459874a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45559 } }
I20260924 12:53:59.166551 22282 leader_election.cc:288] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [CANDIDATE]: Term 1 election: Requested vote from peers 1677b76bb7e749118d99173e16358f82 (127.11.49.67:36255), 62e94ed45cc54676a376663b6459874a (127.11.49.66:45559)
I20260924 12:53:59.167327 22078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa068adf50f14c31adc9b7fe3cc5c5db" candidate_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62e94ed45cc54676a376663b6459874a"
I20260924 12:53:59.167418 22212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa068adf50f14c31adc9b7fe3cc5c5db" candidate_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1677b76bb7e749118d99173e16358f82"
I20260924 12:53:59.167670 22078 raft_consensus.cc:3037] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:59.167742 22212 raft_consensus.cc:3037] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:53:59.170406 22212 raft_consensus.cc:2454] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00d22cdad0eb4b4e8cebe367bc272a45 in term 1.
I20260924 12:53:59.170634 22078 raft_consensus.cc:2454] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00d22cdad0eb4b4e8cebe367bc272a45 in term 1.
I20260924 12:53:59.171235 21880 leader_election.cc:302] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 00d22cdad0eb4b4e8cebe367bc272a45, 1677b76bb7e749118d99173e16358f82, 62e94ed45cc54676a376663b6459874a; no voters:
I20260924 12:53:59.171695 22282 raft_consensus.cc:2781] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:53:59.172585 22282 raft_consensus.cc:686] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 1 LEADER]: Becoming Leader. State: Replica: 00d22cdad0eb4b4e8cebe367bc272a45, State: Running, Role: LEADER
I20260924 12:53:59.173233 22282 consensus_queue.cc:237] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45983 } } peers { permanent_uuid: "1677b76bb7e749118d99173e16358f82" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 36255 } } peers { permanent_uuid: "62e94ed45cc54676a376663b6459874a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45559 } }
I20260924 12:53:59.179634 21799 catalog_manager.cc:5495] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00d22cdad0eb4b4e8cebe367bc272a45 (127.11.49.65). New cstate: current_term: 1 leader_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d22cdad0eb4b4e8cebe367bc272a45" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1677b76bb7e749118d99173e16358f82" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 36255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62e94ed45cc54676a376663b6459874a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45559 } health_report { overall_health: UNKNOWN } } }
I20260924 12:53:59.265224 22272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:59.258793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35382 (local address 127.11.49.65:45983)
0924 12:53:59.259075 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:59.259080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:59.259100 (+ 20us) server_negotiation.cc:407] Connection header received
0924 12:53:59.259317 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:59.259328 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:59.259509 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:59.259727 (+ 218us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:53:59.260143 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.261063 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.262556 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.263062 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.263191 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:59.263788 (+ 597us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:53:59.264566 (+ 778us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:53:59.264705 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:59.264851 (+ 146us) server_negotiation.cc:299] Negotiation successful
0924 12:53:59.264954 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260924 12:53:59.276120 22212 raft_consensus.cc:1261] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82 [term 1 FOLLOWER]: Refusing update from remote peer 00d22cdad0eb4b4e8cebe367bc272a45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:59.276232 22078 raft_consensus.cc:1261] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a [term 1 FOLLOWER]: Refusing update from remote peer 00d22cdad0eb4b4e8cebe367bc272a45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:53:59.277978 22282 consensus_queue.cc:1035] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62e94ed45cc54676a376663b6459874a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:59.278417 22287 consensus_queue.cc:1035] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1677b76bb7e749118d99173e16358f82" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 36255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:53:59.296386 22292 mvcc.cc:205] Tried to move back new op lower bound from 7332882183261020160 to 7332882182857306112. Current Snapshot: MvccSnapshot[applied={T|T < 7332882183261020160}]
I20260924 12:53:59.310631 21800 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34992:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:59.311007 21800 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34992:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:53:59.316845 21800 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d9088aab62eb42438b5b497380d195c4: Sending DeleteTablet for 3 replicas of tablet fa068adf50f14c31adc9b7fe3cc5c5db
I20260924 12:53:59.318483 22192 tablet_service.cc:1514] Processing DeleteTablet for tablet fa068adf50f14c31adc9b7fe3cc5c5db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:59 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:44102
I20260924 12:53:59.318578 21924 tablet_service.cc:1514] Processing DeleteTablet for tablet fa068adf50f14c31adc9b7fe3cc5c5db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:59 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:35374
I20260924 12:53:59.318749 22058 tablet_service.cc:1514] Processing DeleteTablet for tablet fa068adf50f14c31adc9b7fe3cc5c5db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:53:59 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:36128
I20260924 12:53:59.328904 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 21861
I20260924 12:53:59.332378 22300 tablet_replica.cc:330] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: stopping tablet replica
I20260924 12:53:59.333343 22300 raft_consensus.cc:2229] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:59.334192 22300 raft_consensus.cc:2258] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:59.337353 22300 ts_tablet_manager.cc:1905] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:59.338191 22301 tablet_replica.cc:330] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: stopping tablet replica
I20260924 12:53:59.338816 22302 tablet_replica.cc:330] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: stopping tablet replica
I20260924 12:53:59.338899 22301 raft_consensus.cc:2229] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:53:59.339645 22302 raft_consensus.cc:2229] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:53:59.339762 22301 raft_consensus.cc:2258] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:59.340507 22302 raft_consensus.cc:2258] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:53:59.346403 22302 ts_tablet_manager.cc:1905] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:59.347879 22301 ts_tablet_manager.cc:1905] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:53:59.350832 22300 ts_tablet_manager.cc:1918] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:59.351150 22300 log.cc:1196] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/fa068adf50f14c31adc9b7fe3cc5c5db
I20260924 12:53:59.351857 22300 ts_tablet_manager.cc:1939] T fa068adf50f14c31adc9b7fe3cc5c5db P 1677b76bb7e749118d99173e16358f82: Deleting consensus metadata
Sep 24 12:53:59 dist-test-slave-m9hg krb5kdc[21755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:53:59.354875 21787 catalog_manager.cc:4841] TS 1677b76bb7e749118d99173e16358f82 (127.11.49.67:36255): tablet fa068adf50f14c31adc9b7fe3cc5c5db (table test-table [id=f33397fd0727401f86b3dffe8eca790d]) successfully deleted
I20260924 12:53:59.360487 22302 ts_tablet_manager.cc:1918] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:59.361424 22302 log.cc:1196] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/fa068adf50f14c31adc9b7fe3cc5c5db
I20260924 12:53:59.362586 22302 ts_tablet_manager.cc:1939] T fa068adf50f14c31adc9b7fe3cc5c5db P 62e94ed45cc54676a376663b6459874a: Deleting consensus metadata
I20260924 12:53:59.363575 22301 ts_tablet_manager.cc:1918] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:53:59.363867 22301 log.cc:1196] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/fa068adf50f14c31adc9b7fe3cc5c5db
I20260924 12:53:59.364629 22301 ts_tablet_manager.cc:1939] T fa068adf50f14c31adc9b7fe3cc5c5db P 00d22cdad0eb4b4e8cebe367bc272a45: Deleting consensus metadata
I20260924 12:53:59.365895 21786 catalog_manager.cc:4841] TS 62e94ed45cc54676a376663b6459874a (127.11.49.66:45559): tablet fa068adf50f14c31adc9b7fe3cc5c5db (table test-table [id=f33397fd0727401f86b3dffe8eca790d]) successfully deleted
I20260924 12:53:59.366899 21784 catalog_manager.cc:4841] TS 00d22cdad0eb4b4e8cebe367bc272a45 (127.11.49.65:45983): tablet fa068adf50f14c31adc9b7fe3cc5c5db (table test-table [id=f33397fd0727401f86b3dffe8eca790d]) successfully deleted
I20260924 12:53:59.370077 22272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:59.330582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35386 (local address 127.11.49.65:45983)
0924 12:53:59.330847 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:59.330855 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:59.331278 (+ 423us) server_negotiation.cc:407] Connection header received
0924 12:53:59.331549 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:59.331558 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:59.331706 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:59.331837 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:59.339878 (+ 8041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.341502 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.346151 (+ 4649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.347264 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.347424 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:59.357122 (+ 9698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:59.357156 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:59.357186 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:59.357276 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:59.364943 (+ 7667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:59.366599 (+ 1656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:59.366612 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:59.366616 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:59.367066 (+ 450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:59.367789 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:59.367796 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:59.367801 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:59.368497 (+ 696us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:59.368883 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:59.369371 (+ 488us) server_negotiation.cc:299] Negotiation successful
0924 12:53:59.369683 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260924 12:53:59.371311 21984 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:59.490952 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 21861
I20260924 12:53:59.507319 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 21995
Sep 24 12:53:59 dist-test-slave-m9hg krb5kdc[21755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:53:59.527340 22274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:59.508323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36136 (local address 127.11.49.66:45559)
0924 12:53:59.508617 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:59.508626 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:59.508681 (+ 55us) server_negotiation.cc:407] Connection header received
0924 12:53:59.508764 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:59.508771 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:59.508866 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:59.508998 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:59.510404 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.511546 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.513065 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.513768 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.513932 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:59.519041 (+ 5109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:59.519059 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:59.519075 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:59.519133 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:59.523221 (+ 4088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:59.524584 (+ 1363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:59.524594 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:59.524597 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:59.524831 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:59.525366 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:59.525370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:59.525372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:59.525929 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:59.526204 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:59.526695 (+ 491us) server_negotiation.cc:299] Negotiation successful
0924 12:53:59.527001 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260924 12:53:59.528426 22118 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:59.637689 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 21995
I20260924 12:53:59.656260 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 22129
Sep 24 12:53:59 dist-test-slave-m9hg krb5kdc[21755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:53:59.676534 22273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:53:59.657409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44114 (local address 127.11.49.67:36255)
0924 12:53:59.657586 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0924 12:53:59.657591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:53:59.657663 (+ 72us) server_negotiation.cc:407] Connection header received
0924 12:53:59.657905 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:53:59.657910 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:53:59.657988 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:53:59.658124 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:53:59.660250 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.661294 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.663040 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:53:59.663481 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:53:59.663608 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:53:59.669525 (+ 5917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:53:59.669545 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:53:59.669562 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:53:59.669619 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:53:59.673054 (+ 3435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:59.673986 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:59.673995 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:59.673997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:59.674155 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:53:59.674574 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:53:59.674582 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:53:59.674588 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:53:59.675088 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:53:59.675422 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0924 12:53:59.675801 (+ 379us) server_negotiation.cc:299] Negotiation successful
0924 12:53:59.676043 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260924 12:53:59.677517 22252 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:59.782794 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 22129
I20260924 12:53:59.803251 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 21768
I20260924 12:53:59.804898 21830 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:53:59.938230 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 21768
2026-09-24T12:53:59Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (5554 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:54:00 dist-test-slave-m9hg krb5kdc[22310](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:54:00 dist-test-slave-m9hg krb5kdc[22310](info): set up 2 sockets
Sep 24 12:54:00 dist-test-slave-m9hg krb5kdc[22310](info): commencing operation
krb5kdc: starting...
W20260924 12:54:01.186110 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.002s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:54:01 dist-test-slave-m9hg krb5kdc[22310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:54:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:54:01Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.49.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.49.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/rangeradmin_127.11.49.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/rangeradmin_127.11.49.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.49.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.49.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/rangerlookup_127.11.49.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/rangerlookup_127.11.49.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.49.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.49.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/HTTP_127.11.49.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/HTTP_127.11.49.84@KRBTEST.COM.keytab.
I20260924 12:54:01.626483 11461 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskvGPshr/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/postgres -l logfile start
2026-09-24 12:54:04.891 UTC [22340] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-24 12:54:04.891 UTC [22340] LOG: listening on IPv4 address "127.11.49.84", port 33967
2026-09-24 12:54:04.897 UTC [22340] LOG: listening on Unix socket "/tmp/.s.PGSQL.33967"
2026-09-24 12:54:04.928 UTC [22343] LOG: database system was shut down at 2026-09-24 12:54:02 UTC
2026-09-24 12:54:04.933 UTC [22340] LOG: database system is ready to accept connections
I20260924 12:54:05.969448 11461 mini_postgres.cc:96] Postgres bound to 33967
2026-09-24 12:54:05.993 UTC [22351] FATAL: database "slave" does not exist
127.11.49.84:33967 - accepting connections
I20260924 12:54:05.994442 11461 mini_ranger.cc:161] Starting Ranger...
I20260924 12:54:06.030453 11461 mini_ranger.cc:84] Created miniranger Postgres user
I20260924 12:54:06.741186 11461 mini_ranger.cc:87] Created ranger Postgres database
I20260924 12:54:06.741380 11461 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-admin
2026-09-24 12:54:07,084 [I] DB FLAVOR :POSTGRES
2026-09-24 12:54:07,085 [I] --------- Verifying Ranger DB connection ---------
2026-09-24 12:54:07,085 [I] Checking connection..
2026-09-24 12:54:07,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-24 12:54:07,402 [I] Checking connection passed.
2026-09-24 12:54:07,402 [I] --------- Verifying version history table ---------
2026-09-24 12:54:07,402 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 12:54:07,713 [I] Table x_db_version_h does not exist in database ranger
2026-09-24 12:54:07,714 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 12:54:08,038 [I] Table x_db_version_h does not exist in database ranger
2026-09-24 12:54:08,038 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-24 12:54:08,038 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-24 12:54:08.359 UTC [22415] WARNING: there is no transaction in progress
2026-09-24 12:54:08,368 [I] create_dbversion_catalog.sql file imported successfully
2026-09-24 12:54:08,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 12:54:08,654 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-24 12:54:08,654 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-24 12:54:08,654 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-24 12:54:09,004 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-24 12:54:09,322 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-m9hg.c.gcp-upstream.internal','N') ;"
2026-09-24 12:54:09,632 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-24 12:54:09,937 [I] Table x_portal_user does not exist in database ranger
2026-09-24 12:54:09,937 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-24 12:54:10,263 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-24 12:54:10,264 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-24 12:54:10,544 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-24 12:54:10,867 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-24 12:54:10,867 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-24 12:54:12.155 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.181 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.206 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.228 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.249 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.275 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.356 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.365 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.381 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.393 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.405 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.422 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.433 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.441 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.450 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:12.458 UTC [22523] WARNING: there is no transaction in progress
2026-09-24 12:54:13,450 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-24 12:54:13,450 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-24 12:54:13,731 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-24 12:54:13,731 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-24 12:54:14,040 [I] Table x_portal_user already exists in database 'ranger'
2026-09-24 12:54:14,040 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-24 12:54:14,318 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-24 12:54:14,318 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-24 12:54:14,605 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-24 12:54:14,885 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-m9hg.c.gcp-upstream.internal';"
2026-09-24 12:54:15,183 [I] CORE_DB_SCHEMA import status has been updated
2026-09-24 12:54:15,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-24 12:54:15,506 [I] DB_PATCHES have already been applied
I20260924 12:54:15.514369 11461 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-admin:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskvGPshr/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260924 12:54:15.514520 11461 mini_ranger.cc:193] Using host: 127.11.49.84
I20260924 12:54:15.534252 11461 mini_ranger.cc:227] Ranger admin URL: http://127.11.49.84:48851
Sep 24, 2026 12:54:15 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 24, 2026 12:54:15 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 24, 2026 12:54:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-admin/ews/webapp
Sep 24, 2026 12:54:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 24, 2026 12:54:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 24, 2026 12:54:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-admin/ews/webapp].
Sep 24, 2026 12:54:16 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260924 12:54:16.755427 11461 mini_ranger.cc:160] Time spent starting Ranger: real 10.761s user 0.000s sys 0.054s
Sep 24, 2026 12:54:43 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 24, 2026 12:54:43 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Sep 24, 2026 12:54:43 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 24, 2026 12:54:43 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 24, 2026 12:54:44 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260924 12:54:45.435145 11461 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.49.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.49.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/rangerkms_127.11.49.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/rangerkms_127.11.49.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.49.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.49.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.49.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/HTTP_127.11.49.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.49.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/HTTP_127.11.49.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 24 12:54:45 dist-test-slave-m9hg krb5kdc[22310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254485, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260924 12:54:45.708843 11461 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260924 12:54:45.742113 11461 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260924 12:54:46.779431 11461 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260924 12:54:46.779623 11461 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-kms
I20260924 12:54:46.779772 11461 mini_ranger_kms.cc:227] Using postgres at 127.11.49.84:33967
2026-09-24 12:54:47,246 [I] DB FLAVOR :POSTGRES
2026-09-24 12:54:47,247 [I] --------- Verifying Ranger DB connection ---------
2026-09-24 12:54:47,247 [I] Checking connection
2026-09-24 12:54:47,247 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-24 12:54:47,613 [I] connection success
2026-09-24 12:54:47,614 [I] --------- Verifying Ranger DB tables ---------
2026-09-24 12:54:47,614 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-24 12:54:47,614 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-24 12:54:47,910 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-24 12:54:47,910 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-24 12:54:47,910 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-24 12:54:47,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:33967/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-24 12:54:48,242 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260924 12:54:48.947250 11461 mini_ranger_kms.cc:310] Created kms service
I20260924 12:54:49.235684 11461 mini_ranger_kms.cc:326] Created kudu user
I20260924 12:54:49.308853 11461 mini_ranger_kms.cc:343] Created rangerkms user
Sep 24 12:54:49 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254485, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:54:49.826989 11461 mini_ranger_kms.cc:384] Added ranger policy
I20260924 12:54:49.827369 11461 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-kms:/tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260924 12:54:49.827445 11461 mini_ranger_kms.cc:240] Using host: 127.11.49.84
I20260924 12:54:49.847613 11461 mini_ranger_kms.cc:276] Ranger KMS PID: 22704
I20260924 12:54:49.847955 11461 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.49.84:35411
Sep 24, 2026 12:54:51 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 24, 2026 12:54:51 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 24, 2026 12:54:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 24, 2026 12:54:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 24, 2026 12:54:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-kms/ews/webapp].
Sep 24, 2026 12:54:51 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260924 12:54:52.373289 11461 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.664s user 0.131s sys 0.367s
I20260924 12:54:52.373664 11461 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260924 12:54:52.373950 11461 mini_ranger_kms.cc:401] 127.11.49.84:35411/kms/v1/keys
Sep 24 12:54:52 dist-test-slave-m9hg krb5kdc[22310](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790254492, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.49.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 24 12:54:53 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254492, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.49.84@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
Sep 24 12:54:53 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254492, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.49.84@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
Sep 24 12:54:56 dist-test-slave-m9hg krb5kdc[22310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:54:56.846356 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42683
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:44469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:42683
--ranger_config_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:35411/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:54:57.273769 22754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:54:57.274186 22754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:54:57.274570 22754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:54:57.286949 22754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:54:57.287222 22754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:54:57.287346 22754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:54:57.287439 22754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:54:57.287513 22754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:54:57.301468 22754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:44469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.49.84:35411/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:42683
--ranger_config_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:54:57.303372 22754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:54:57.305183 22754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:54:57.324011 22760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:54:57.324786 22759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:54:57.324316 22762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:54:57.325730 22754 server_base.cc:1034] running on GCE node
I20260924 12:54:57.326833 22754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:54:57.328883 22754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:54:57.330278 22754 hybrid_clock.cc:648] HybridClock initialized: now 1790254497330160 us; error 108 us; skew 500 ppm
I20260924 12:54:57.331060 22754 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:54:57 dist-test-slave-m9hg krb5kdc[22310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254497, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:54:57.336139 22754 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:54:57.339236 22754 webserver.cc:460] Webserver started at http://127.11.49.126:43499/ using document root <none> and password file <none>
I20260924 12:54:57.340519 22754 fs_manager.cc:359] Metadata directory not provided
I20260924 12:54:57.340713 22754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:54:57.341176 22754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 12:54:57 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254497, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:54:57.430538 22754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "0e853cd6504949ff964d54c7943e1124"
format_stamp: "Formatted at 2026-09-24 12:54:57 on dist-test-slave-m9hg"
server_key: "3600f4052915c5117d88a012cc751eed"
server_key_iv: "532210e30326d6eddedc2af1fca7aa24"
server_key_version: "kuduclusterkey@0"
I20260924 12:54:57.432026 22754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "0e853cd6504949ff964d54c7943e1124"
format_stamp: "Formatted at 2026-09-24 12:54:57 on dist-test-slave-m9hg"
server_key: "3600f4052915c5117d88a012cc751eed"
server_key_iv: "532210e30326d6eddedc2af1fca7aa24"
server_key_version: "kuduclusterkey@0"
I20260924 12:54:57.439031 22754 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260924 12:54:57.471071 22769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:54:57.474625 22754 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260924 12:54:57.474994 22754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "0e853cd6504949ff964d54c7943e1124"
format_stamp: "Formatted at 2026-09-24 12:54:57 on dist-test-slave-m9hg"
server_key: "3600f4052915c5117d88a012cc751eed"
server_key_iv: "532210e30326d6eddedc2af1fca7aa24"
server_key_version: "kuduclusterkey@0"
I20260924 12:54:57.475615 22754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:54:57.521236 22754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:54:57.529099 22754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:54:57.529562 22754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:54:57.559013 22820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:42683 every 8 connection(s)
I20260924 12:54:57.559002 22754 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:42683
I20260924 12:54:57.561759 22754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:54:57.566596 22821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:54:57.568148 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 22754
I20260924 12:54:57.568527 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:54:57.569465 11461 external_mini_cluster.cc:1428] Setting key 1c2ade2f033fef3b57a28a38e65f34c7
I20260924 12:54:57.584355 22821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124: Bootstrap starting.
I20260924 12:54:57.590689 22821 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124: Neither blocks nor log segments found. Creating new log.
I20260924 12:54:57.592582 22821 log.cc:824] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124: Log is configured to *not* fsync() on all Append() calls
I20260924 12:54:57.600178 22821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124: No bootstrap required, opened a new log
Sep 24 12:54:57 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:54:57.612174 22821 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853cd6504949ff964d54c7943e1124" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42683 } }
I20260924 12:54:57.612906 22821 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:54:57.613056 22821 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e853cd6504949ff964d54c7943e1124, State: Initialized, Role: FOLLOWER
I20260924 12:54:57.613986 22821 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853cd6504949ff964d54c7943e1124" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42683 } }
I20260924 12:54:57.614387 22821 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:54:57.614609 22821 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:54:57.614856 22821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:54:57.619186 22821 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853cd6504949ff964d54c7943e1124" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42683 } }
I20260924 12:54:57.620133 22821 leader_election.cc:302] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e853cd6504949ff964d54c7943e1124; no voters:
I20260924 12:54:57.621384 22821 leader_election.cc:288] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:54:57.624027 22826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:54:57.626021 22824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:54:57.572213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48560 (local address 127.11.49.126:42683)
0924 12:54:57.589266 (+ 17053us) server_negotiation.cc:206] Beginning negotiation
0924 12:54:57.589294 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0924 12:54:57.589405 (+ 111us) server_negotiation.cc:407] Connection header received
0924 12:54:57.593073 (+ 3668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:54:57.593129 (+ 56us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:54:57.594019 (+ 890us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:54:57.594723 (+ 704us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:54:57.596691 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:54:57.599981 (+ 3290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:54:57.602662 (+ 2681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:54:57.603911 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:54:57.604147 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:54:57.614238 (+ 10091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:54:57.614258 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:54:57.614289 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:54:57.614378 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:54:57.619208 (+ 4830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:54:57.620496 (+ 1288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:54:57.620509 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:54:57.620522 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:54:57.620847 (+ 325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:54:57.621427 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:54:57.621433 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:54:57.621436 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:54:57.622249 (+ 813us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:54:57.622533 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0924 12:54:57.623279 (+ 746us) server_negotiation.cc:299] Negotiation successful
0924 12:54:57.624068 (+ 789us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16626,"thread_start_us":16170,"threads_started":1}
I20260924 12:54:57.626809 22826 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [term 1 LEADER]: Becoming Leader. State: Replica: 0e853cd6504949ff964d54c7943e1124, State: Running, Role: LEADER
I20260924 12:54:57.626428 22821 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:54:57.627774 22826 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853cd6504949ff964d54c7943e1124" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42683 } }
I20260924 12:54:57.635161 22827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e853cd6504949ff964d54c7943e1124" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853cd6504949ff964d54c7943e1124" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42683 } } }
I20260924 12:54:57.637475 22827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [sys.catalog]: This master's current role is: LEADER
I20260924 12:54:57.636725 22828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e853cd6504949ff964d54c7943e1124. Latest consensus state: current_term: 1 leader_uuid: "0e853cd6504949ff964d54c7943e1124" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853cd6504949ff964d54c7943e1124" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42683 } } }
I20260924 12:54:57.639413 22828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124 [sys.catalog]: This master's current role is: LEADER
I20260924 12:54:57.646721 22832 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:54:57.660159 22832 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:54:57.661293 22821 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260924 12:54:57.691845 22832 catalog_manager.cc:1347] Generated new cluster ID: 18ce1e63433d45069226676cd67e4fbb
I20260924 12:54:57.692194 22832 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:54:57.760615 22832 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:54:57.763502 22832 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:54:57.778149 22832 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124: Generated new TSK 0
I20260924 12:54:57.780165 22832 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:54:58.683706 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:35411/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42683
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:44469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:54:59 dist-test-slave-m9hg krb5kdc[22310](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790254499, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260924 12:54:59.267222 22866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:54:59.267722 22866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:54:59.267920 22866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:54:59.278650 22866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:54:59.278898 22866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:54:59.279157 22866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:54:59.294288 22866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:44469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.49.84:35411/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:54:59.296469 22866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:54:59.299413 22866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:54:59.336460 22877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:54:59.336460 22876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:54:59.348217 22866 server_base.cc:1034] running on GCE node
W20260924 12:54:59.348735 22879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:54:59.349888 22866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:54:59.353729 22866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:54:59.355733 22866 hybrid_clock.cc:648] HybridClock initialized: now 1790254499355610 us; error 82 us; skew 500 ppm
I20260924 12:54:59.356498 22866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:54:59 dist-test-slave-m9hg krb5kdc[22310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254499, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:54:59.362879 22866 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:54:59.365499 22866 webserver.cc:460] Webserver started at http://127.11.49.65:33649/ using document root <none> and password file <none>
I20260924 12:54:59.366382 22866 fs_manager.cc:359] Metadata directory not provided
I20260924 12:54:59.366564 22866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:54:59.366948 22866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 12:54:59 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254499, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:54:59.391574 22866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "84ce37420b064c329a78a263f4d45888"
format_stamp: "Formatted at 2026-09-24 12:54:59 on dist-test-slave-m9hg"
server_key: "327edd2571c2db2b09253c08dcc19213"
server_key_iv: "4dddeb988b0dfd1149a0a0f439d8aae5"
server_key_version: "kuduclusterkey@0"
I20260924 12:54:59.392814 22866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "84ce37420b064c329a78a263f4d45888"
format_stamp: "Formatted at 2026-09-24 12:54:59 on dist-test-slave-m9hg"
server_key: "327edd2571c2db2b09253c08dcc19213"
server_key_iv: "4dddeb988b0dfd1149a0a0f439d8aae5"
server_key_version: "kuduclusterkey@0"
I20260924 12:54:59.401973 22866 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.002s sys 0.005s
I20260924 12:54:59.445183 22886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:54:59.447520 22866 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.005s sys 0.009s
I20260924 12:54:59.447775 22866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "84ce37420b064c329a78a263f4d45888"
format_stamp: "Formatted at 2026-09-24 12:54:59 on dist-test-slave-m9hg"
server_key: "327edd2571c2db2b09253c08dcc19213"
server_key_iv: "4dddeb988b0dfd1149a0a0f439d8aae5"
server_key_version: "kuduclusterkey@0"
I20260924 12:54:59.448083 22866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:54:59.500562 22866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:54:59.509394 22866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:54:59.510022 22866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:54:59.512378 22866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:54:59.517855 22866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:54:59.518107 22866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260924 12:54:59.518296 22866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:54:59.518374 22866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 12:54:59 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254499, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:54:59.733464 22866 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:36241
I20260924 12:54:59.733507 22998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:36241 every 8 connection(s)
I20260924 12:54:59.736320 22866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:54:59.737694 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 22866
I20260924 12:54:59.737932 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:54:59.738816 11461 external_mini_cluster.cc:1428] Setting key 1854f70f5be8f101230f1622f6ebb839
Sep 24 12:54:59 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254499, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:54:59.792773 23001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:54:59.746332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:43807 (local address 127.11.49.126:42683)
0924 12:54:59.766074 (+ 19742us) server_negotiation.cc:206] Beginning negotiation
0924 12:54:59.766085 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:54:59.767939 (+ 1854us) server_negotiation.cc:407] Connection header received
0924 12:54:59.770492 (+ 2553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:54:59.770498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:54:59.770624 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:54:59.770738 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:54:59.773228 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:54:59.774633 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:54:59.777697 (+ 3064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:54:59.778543 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:54:59.778675 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:54:59.784203 (+ 5528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:54:59.784215 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:54:59.784221 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:54:59.784313 (+ 92us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:54:59.788528 (+ 4215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:54:59.789829 (+ 1301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:54:59.789834 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:54:59.789836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:54:59.789982 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:54:59.790688 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:54:59.790694 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:54:59.790697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:54:59.791001 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:54:59.791170 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0924 12:54:59.792016 (+ 846us) server_negotiation.cc:299] Negotiation successful
0924 12:54:59.792363 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19513,"thread_start_us":19759,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
I20260924 12:54:59.794342 23000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:54:59.745510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42683 (local address 127.11.49.65:43807)
0924 12:54:59.767401 (+ 21891us) negotiation.cc:107] Waiting for socket to connect
0924 12:54:59.767463 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0924 12:54:59.770139 (+ 2676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:54:59.771240 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:54:59.771257 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:54:59.771967 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:54:59.772942 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:54:59.772974 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:54:59.774896 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:54:59.774904 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:54:59.777443 (+ 2539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:54:59.777480 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:54:59.779153 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:54:59.779163 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:54:59.779526 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:54:59.780483 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:54:59.780528 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:54:59.783811 (+ 3283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:54:59.788786 (+ 4975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:54:59.788801 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:54:59.788825 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:54:59.789569 (+ 744us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:54:59.790116 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:54:59.790122 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:54:59.790125 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:54:59.790535 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:54:59.791151 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:54:59.791160 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:54:59.791613 (+ 453us) client_negotiation.cc:769] Sending connection context
0924 12:54:59.791910 (+ 297us) client_negotiation.cc:240] Negotiation successful
0924 12:54:59.792536 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21553,"thread_start_us":20772,"threads_started":1}
I20260924 12:54:59.796803 22999 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42683
I20260924 12:54:59.797180 22999 heartbeater.cc:464] Registering TS with master...
I20260924 12:54:59.798167 22999 heartbeater.cc:511] Master 127.11.49.126:42683 requested a full tablet report, sending...
I20260924 12:54:59.801869 22786 ts_manager.cc:194] Registered new tserver with Master: 84ce37420b064c329a78a263f4d45888 (127.11.49.65:36241)
I20260924 12:54:59.804224 22786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:43807
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:54:59.834286 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:35411/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42683
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:44469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:55:00 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254499, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
W20260924 12:55:00.391736 23005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:55:00.392184 23005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:55:00.392385 23005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:55:00.404453 23005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:55:00.404728 23005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:55:00.404963 23005 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:55:00.421155 23005 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:44469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.49.84:35411/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:55:00.423267 23005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:55:00.425051 23005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:55:00.453547 23014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:55:00.454360 23020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:55:00.453652 23015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:55:00.456624 23005 server_base.cc:1034] running on GCE node
I20260924 12:55:00.457540 23005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:55:00.458660 23005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:55:00.459992 23005 hybrid_clock.cc:648] HybridClock initialized: now 1790254500459928 us; error 61 us; skew 500 ppm
I20260924 12:55:00.460467 23005 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:55:00 dist-test-slave-m9hg krb5kdc[22310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254500, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:55:00.464012 23005 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:55:00.465935 23005 webserver.cc:460] Webserver started at http://127.11.49.66:34693/ using document root <none> and password file <none>
I20260924 12:55:00.466684 23005 fs_manager.cc:359] Metadata directory not provided
I20260924 12:55:00.466858 23005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:55:00.467185 23005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 12:55:00 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254500, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:55:00.488718 23005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "744d9d518afd4110b8e09a551af20917"
format_stamp: "Formatted at 2026-09-24 12:55:00 on dist-test-slave-m9hg"
server_key: "d0c2a7ee5fc64c37bcc40a63e451fc91"
server_key_iv: "d315814de7d8458ace77d12df47dc3bb"
server_key_version: "kuduclusterkey@0"
I20260924 12:55:00.489993 23005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "744d9d518afd4110b8e09a551af20917"
format_stamp: "Formatted at 2026-09-24 12:55:00 on dist-test-slave-m9hg"
server_key: "d0c2a7ee5fc64c37bcc40a63e451fc91"
server_key_iv: "d315814de7d8458ace77d12df47dc3bb"
server_key_version: "kuduclusterkey@0"
I20260924 12:55:00.500564 23005 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.009s sys 0.000s
I20260924 12:55:00.523409 23029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:55:00.525893 23005 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260924 12:55:00.526182 23005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "744d9d518afd4110b8e09a551af20917"
format_stamp: "Formatted at 2026-09-24 12:55:00 on dist-test-slave-m9hg"
server_key: "d0c2a7ee5fc64c37bcc40a63e451fc91"
server_key_iv: "d315814de7d8458ace77d12df47dc3bb"
server_key_version: "kuduclusterkey@0"
I20260924 12:55:00.526497 23005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:55:00.554741 23005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:55:00.561074 23005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:55:00.561480 23005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:55:00.575722 23005 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:55:00.577711 23005 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:55:00.577838 23005 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:55:00.578002 23005 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:55:00.578079 23005 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:55:00.626065 23005 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:39173
I20260924 12:55:00.626075 23141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:39173 every 8 connection(s)
I20260924 12:55:00.627674 23005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:55:00.637498 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 23005
I20260924 12:55:00.637745 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:55:00.638679 11461 external_mini_cluster.cc:1428] Setting key fae88dc475ec661d96ee2049ce7bd6bb
Sep 24 12:55:00 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254500, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:55:00.673172 23145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:00.632495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42683 (local address 127.11.49.66:58693)
0924 12:55:00.645230 (+ 12735us) negotiation.cc:107] Waiting for socket to connect
0924 12:55:00.645323 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0924 12:55:00.648583 (+ 3260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:55:00.650020 (+ 1437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:55:00.650038 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:55:00.650809 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:55:00.651761 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:00.651795 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:00.654158 (+ 2363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:00.654164 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:00.656052 (+ 1888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:00.656071 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:00.658122 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:00.658131 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:00.658468 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:00.659775 (+ 1307us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:55:00.659810 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:55:00.662817 (+ 3007us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:55:00.667430 (+ 4613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:55:00.667451 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:55:00.667474 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:55:00.668198 (+ 724us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:55:00.668795 (+ 597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:55:00.668801 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:55:00.668805 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:55:00.669100 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:55:00.669882 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:55:00.669892 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:55:00.670507 (+ 615us) client_negotiation.cc:769] Sending connection context
0924 12:55:00.670842 (+ 335us) client_negotiation.cc:240] Negotiation successful
0924 12:55:00.671483 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12202,"thread_start_us":15636,"threads_started":1}
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
I20260924 12:55:00.675462 23144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:00.631478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:58693 (local address 127.11.49.126:42683)
0924 12:55:00.647293 (+ 15815us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:00.647303 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:00.647338 (+ 35us) server_negotiation.cc:407] Connection header received
0924 12:55:00.649340 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:00.649347 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:00.649481 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:00.649623 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:55:00.652458 (+ 2835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:00.653904 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:00.656350 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:00.657765 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:00.658993 (+ 1228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:00.663176 (+ 4183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:55:00.663183 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:55:00.663188 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:55:00.663236 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:55:00.667186 (+ 3950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:00.668442 (+ 1256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:00.668448 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:00.668452 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:00.668639 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:00.669270 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:00.669275 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:00.669279 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:00.669703 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:55:00.674530 (+ 4827us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:00.674737 (+ 207us) server_negotiation.cc:299] Negotiation successful
0924 12:55:00.675020 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15620,"thread_start_us":15850,"threads_started":1}
I20260924 12:55:00.677906 23142 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42683
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
I20260924 12:55:00.678367 23142 heartbeater.cc:464] Registering TS with master...
I20260924 12:55:00.679384 23142 heartbeater.cc:511] Master 127.11.49.126:42683 requested a full tablet report, sending...
I20260924 12:55:00.685659 22786 ts_manager.cc:194] Registered new tserver with Master: 744d9d518afd4110b8e09a551af20917 (127.11.49.66:39173)
I20260924 12:55:00.687062 22786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:58693
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:55:00.724962 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:35411/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42683
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:44469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:55:00.814265 22999 heartbeater.cc:503] Master 127.11.49.126:42683 was elected leader, sending a full tablet report...
W20260924 12:55:01.183001 23148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:55:01.183434 23148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:55:01.183604 23148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:55:01.192881 23148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:55:01.193056 23148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:55:01.193382 23148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:55:01.205236 23148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:44469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.49.84:35411/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:55:01.206804 23148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:55:01.208194 23148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:55:01.228720 23153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:55:01.232156 23154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:55:01.239697 23156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:55:01.240537 23148 server_base.cc:1034] running on GCE node
I20260924 12:55:01.241344 23148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:55:01.242487 23148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:55:01.243829 23148 hybrid_clock.cc:648] HybridClock initialized: now 1790254501243746 us; error 60 us; skew 500 ppm
I20260924 12:55:01.244231 23148 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:55:01 dist-test-slave-m9hg krb5kdc[22310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254501, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:55:01.248056 23148 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:55:01.255017 23148 webserver.cc:460] Webserver started at http://127.11.49.67:45517/ using document root <none> and password file <none>
I20260924 12:55:01.255867 23148 fs_manager.cc:359] Metadata directory not provided
I20260924 12:55:01.256027 23148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:55:01.256438 23148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 12:55:01 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254501, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:55:01.275458 23148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "f20ca98656944f5b9b6af0fead2e065e"
format_stamp: "Formatted at 2026-09-24 12:55:01 on dist-test-slave-m9hg"
server_key: "be4589689ba45ad61295fe7ba39f6afe"
server_key_iv: "b57f3d5a8137738b261c61b3acf97899"
server_key_version: "kuduclusterkey@0"
I20260924 12:55:01.276546 23148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "f20ca98656944f5b9b6af0fead2e065e"
format_stamp: "Formatted at 2026-09-24 12:55:01 on dist-test-slave-m9hg"
server_key: "be4589689ba45ad61295fe7ba39f6afe"
server_key_iv: "b57f3d5a8137738b261c61b3acf97899"
server_key_version: "kuduclusterkey@0"
I20260924 12:55:01.283120 23148 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260924 12:55:01.304426 23163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:55:01.306151 23148 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260924 12:55:01.306365 23148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "f20ca98656944f5b9b6af0fead2e065e"
format_stamp: "Formatted at 2026-09-24 12:55:01 on dist-test-slave-m9hg"
server_key: "be4589689ba45ad61295fe7ba39f6afe"
server_key_iv: "b57f3d5a8137738b261c61b3acf97899"
server_key_version: "kuduclusterkey@0"
I20260924 12:55:01.306608 23148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:55:01.324816 23148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:55:01.330202 23148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:55:01.330644 23148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:55:01.331892 23148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:55:01.333822 23148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:55:01.333943 23148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:55:01.334107 23148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:55:01.334182 23148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:55:01.391119 23148 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:40281
I20260924 12:55:01.391465 23275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:40281 every 8 connection(s)
I20260924 12:55:01.393718 23148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:55:01.403873 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 23148
I20260924 12:55:01.404130 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:55:01.404627 11461 external_mini_cluster.cc:1428] Setting key 946fa342b18e70fc38bfd45189b540d4
Sep 24 12:55:01 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254501, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:55:01.419590 23278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.397493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:50983 (local address 127.11.49.126:42683)
0924 12:55:01.398174 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:01.398181 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:01.399295 (+ 1114us) server_negotiation.cc:407] Connection header received
0924 12:55:01.401517 (+ 2222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:01.401527 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:01.401665 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:01.401849 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:55:01.403587 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.404899 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.407301 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.408073 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.408247 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.412862 (+ 4615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:55:01.412868 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:55:01.412872 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:55:01.412913 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:55:01.415653 (+ 2740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:01.416740 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:01.416746 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:01.416750 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:01.416891 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:01.417452 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:01.417456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:01.417459 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:01.417815 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:55:01.417968 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:01.418711 (+ 743us) server_negotiation.cc:299] Negotiation successful
0924 12:55:01.418985 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":345,"threads_started":1}
I20260924 12:55:01.420346 23279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.398159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42683 (local address 127.11.49.67:50983)
0924 12:55:01.399052 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0924 12:55:01.399114 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0924 12:55:01.401111 (+ 1997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:55:01.402114 (+ 1003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:55:01.402123 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:55:01.402585 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:55:01.403309 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.403329 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.405160 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.405166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.407067 (+ 1901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.407108 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.408439 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.408460 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.408705 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.409766 (+ 1061us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:55:01.409792 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:55:01.412475 (+ 2683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:55:01.415847 (+ 3372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:55:01.415858 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:55:01.415878 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:55:01.416568 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:55:01.417017 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:55:01.417022 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:55:01.417027 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:55:01.417245 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:55:01.417971 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:55:01.417979 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:55:01.418314 (+ 335us) client_negotiation.cc:769] Sending connection context
0924 12:55:01.418560 (+ 246us) client_negotiation.cc:240] Negotiation successful
0924 12:55:01.418985 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":405,"threads_started":1}
I20260924 12:55:01.422051 23276 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42683
I20260924 12:55:01.422415 23276 heartbeater.cc:464] Registering TS with master...
I20260924 12:55:01.423349 23276 heartbeater.cc:511] Master 127.11.49.126:42683 requested a full tablet report, sending...
I20260924 12:55:01.425276 22785 ts_manager.cc:194] Registered new tserver with Master: f20ca98656944f5b9b6af0fead2e065e (127.11.49.67:40281)
I20260924 12:55:01.426338 22785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:50983
I20260924 12:55:01.437817 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:55:01.460990 23278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.443911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48562 (local address 127.11.49.126:42683)
0924 12:55:01.444102 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:01.444131 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:01.444970 (+ 839us) server_negotiation.cc:407] Connection header received
0924 12:55:01.445271 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:01.445275 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:01.445346 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:01.445466 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:55:01.447361 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.448134 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.450352 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.450839 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.450994 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.453860 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:55:01.453866 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:55:01.453870 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:55:01.453910 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:55:01.457752 (+ 3842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:01.458631 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:01.458642 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:01.458645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:01.458774 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:01.459191 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:01.459196 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:01.459201 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:01.459545 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:55:01.459926 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:01.460381 (+ 455us) server_negotiation.cc:299] Negotiation successful
0924 12:55:01.460633 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260924 12:55:01.467779 22785 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48562:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:55:01.475878 22785 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:55:01.518850 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.501492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36241 (local address 127.0.0.1:50306)
0924 12:55:01.502447 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0924 12:55:01.502476 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0924 12:55:01.502913 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:55:01.503947 (+ 1034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:55:01.503975 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:55:01.504033 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:55:01.504927 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.504956 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.508262 (+ 3306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.508269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.514956 (+ 6687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.514965 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.517684 (+ 2719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.517690 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.517907 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.517968 (+ 61us) client_negotiation.cc:769] Sending connection context
0924 12:55:01.518115 (+ 147us) client_negotiation.cc:240] Negotiation successful
0924 12:55:01.518365 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"mutex_wait_us":396,"thread_start_us":561,"threads_started":1}
I20260924 12:55:01.520185 23291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.498751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50306 (local address 127.11.49.65:36241)
0924 12:55:01.501183 (+ 2432us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:01.501198 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:01.502850 (+ 1652us) server_negotiation.cc:407] Connection header received
0924 12:55:01.503155 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:01.503166 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:01.503411 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:01.503620 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:55:01.505451 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.507991 (+ 2540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.515441 (+ 7450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.517027 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.517204 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.517475 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:01.519503 (+ 2028us) server_negotiation.cc:299] Negotiation successful
0924 12:55:01.519749 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2099,"thread_start_us":680,"threads_started":1}
I20260924 12:55:01.520539 23289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.497391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33606 (local address 127.11.49.67:40281)
0924 12:55:01.498450 (+ 1059us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:01.498470 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:01.502170 (+ 3700us) server_negotiation.cc:407] Connection header received
0924 12:55:01.502654 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:01.502663 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:01.503006 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:01.503278 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:55:01.507655 (+ 4377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.509543 (+ 1888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.515242 (+ 5699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.517027 (+ 1785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.517204 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.517479 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:01.519353 (+ 1874us) server_negotiation.cc:299] Negotiation successful
0924 12:55:01.519639 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":492,"threads_started":1}
I20260924 12:55:01.521523 23290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.497184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:40281 (local address 127.0.0.1:33606)
0924 12:55:01.501924 (+ 4740us) negotiation.cc:107] Waiting for socket to connect
0924 12:55:01.501986 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0924 12:55:01.502381 (+ 395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:55:01.506304 (+ 3923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:55:01.506314 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:55:01.506378 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:55:01.507077 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.507096 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.509696 (+ 2600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.509703 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.514901 (+ 5198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.514937 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.518280 (+ 3343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.518289 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.518487 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.518528 (+ 41us) client_negotiation.cc:769] Sending connection context
0924 12:55:01.518802 (+ 274us) client_negotiation.cc:240] Negotiation successful
0924 12:55:01.521040 (+ 2238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4419,"mutex_wait_us":149,"thread_start_us":4185,"threads_started":1}
I20260924 12:55:01.525490 22934 tablet_service.cc:1467] Processing CreateTablet for tablet 2caab6bfd64a4c978e7c96192cca3eca (DEFAULT_TABLE table=test-table [id=06cc8caab69b403bb4e818ddd1d2c853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:55:01.527460 22934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2caab6bfd64a4c978e7c96192cca3eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:55:01.527666 23211 tablet_service.cc:1467] Processing CreateTablet for tablet 2caab6bfd64a4c978e7c96192cca3eca (DEFAULT_TABLE table=test-table [id=06cc8caab69b403bb4e818ddd1d2c853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:55:01.528563 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.504041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40966 (local address 127.11.49.66:39173)
0924 12:55:01.509776 (+ 5735us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:01.509795 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:01.514207 (+ 4412us) server_negotiation.cc:407] Connection header received
0924 12:55:01.514706 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:01.514715 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:01.515103 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:01.515504 (+ 401us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:55:01.516215 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.519021 (+ 2806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.523887 (+ 4866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.526012 (+ 2125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.526167 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.526410 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:01.527871 (+ 1461us) server_negotiation.cc:299] Negotiation successful
0924 12:55:01.528132 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4952,"thread_start_us":5652,"threads_started":1}
I20260924 12:55:01.529103 23293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.503002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:39173 (local address 127.0.0.1:40966)
0924 12:55:01.513986 (+ 10984us) negotiation.cc:107] Waiting for socket to connect
0924 12:55:01.514009 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:55:01.514258 (+ 249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:55:01.515472 (+ 1214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:55:01.515477 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:55:01.515514 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:55:01.516004 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.516017 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.519254 (+ 3237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.519260 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.523502 (+ 4242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.523550 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.526702 (+ 3152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.526707 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.526995 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.527038 (+ 43us) client_negotiation.cc:769] Sending connection context
0924 12:55:01.527197 (+ 159us) client_negotiation.cc:240] Negotiation successful
0924 12:55:01.527395 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10791,"thread_start_us":10518,"threads_started":1}
I20260924 12:55:01.529582 23211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2caab6bfd64a4c978e7c96192cca3eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:55:01.534219 23077 tablet_service.cc:1467] Processing CreateTablet for tablet 2caab6bfd64a4c978e7c96192cca3eca (DEFAULT_TABLE table=test-table [id=06cc8caab69b403bb4e818ddd1d2c853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:55:01.535979 23077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2caab6bfd64a4c978e7c96192cca3eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:55:01.546835 23295 tablet_bootstrap.cc:492] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: Bootstrap starting.
I20260924 12:55:01.553016 23296 tablet_bootstrap.cc:492] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: Bootstrap starting.
I20260924 12:55:01.556003 23295 tablet_bootstrap.cc:654] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: Neither blocks nor log segments found. Creating new log.
I20260924 12:55:01.557570 23296 tablet_bootstrap.cc:654] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: Neither blocks nor log segments found. Creating new log.
I20260924 12:55:01.559098 23296 log.cc:824] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: Log is configured to *not* fsync() on all Append() calls
I20260924 12:55:01.559255 23295 log.cc:824] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: Log is configured to *not* fsync() on all Append() calls
I20260924 12:55:01.566413 23297 tablet_bootstrap.cc:492] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: Bootstrap starting.
I20260924 12:55:01.569448 23296 tablet_bootstrap.cc:492] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: No bootstrap required, opened a new log
I20260924 12:55:01.570173 23296 ts_tablet_manager.cc:1397] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.003s
I20260924 12:55:01.575037 23297 tablet_bootstrap.cc:654] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: Neither blocks nor log segments found. Creating new log.
I20260924 12:55:01.576849 23295 tablet_bootstrap.cc:492] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: No bootstrap required, opened a new log
I20260924 12:55:01.578792 23297 log.cc:824] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: Log is configured to *not* fsync() on all Append() calls
I20260924 12:55:01.581687 23295 ts_tablet_manager.cc:1397] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: Time spent bootstrapping tablet: real 0.035s user 0.019s sys 0.005s
I20260924 12:55:01.583834 23296 raft_consensus.cc:348] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20ca98656944f5b9b6af0fead2e065e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40281 } } peers { permanent_uuid: "84ce37420b064c329a78a263f4d45888" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36241 } } peers { permanent_uuid: "744d9d518afd4110b8e09a551af20917" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 39173 } }
I20260924 12:55:01.584614 23296 raft_consensus.cc:374] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:55:01.584786 23296 raft_consensus.cc:729] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744d9d518afd4110b8e09a551af20917, State: Initialized, Role: FOLLOWER
I20260924 12:55:01.586297 23296 consensus_queue.cc:260] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20ca98656944f5b9b6af0fead2e065e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40281 } } peers { permanent_uuid: "84ce37420b064c329a78a263f4d45888" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36241 } } peers { permanent_uuid: "744d9d518afd4110b8e09a551af20917" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 39173 } }
I20260924 12:55:01.594189 23297 tablet_bootstrap.cc:492] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: No bootstrap required, opened a new log
I20260924 12:55:01.594687 23297 ts_tablet_manager.cc:1397] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: Time spent bootstrapping tablet: real 0.029s user 0.019s sys 0.008s
I20260924 12:55:01.595050 23296 ts_tablet_manager.cc:1428] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: Time spent starting tablet: real 0.025s user 0.016s sys 0.007s
I20260924 12:55:01.595839 23142 heartbeater.cc:503] Master 127.11.49.126:42683 was elected leader, sending a full tablet report...
I20260924 12:55:01.606755 23295 raft_consensus.cc:348] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20ca98656944f5b9b6af0fead2e065e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40281 } } peers { permanent_uuid: "84ce37420b064c329a78a263f4d45888" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36241 } } peers { permanent_uuid: "744d9d518afd4110b8e09a551af20917" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 39173 } }
I20260924 12:55:01.607574 23295 raft_consensus.cc:374] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:55:01.607733 23295 raft_consensus.cc:729] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84ce37420b064c329a78a263f4d45888, State: Initialized, Role: FOLLOWER
I20260924 12:55:01.609050 23295 consensus_queue.cc:260] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20ca98656944f5b9b6af0fead2e065e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40281 } } peers { permanent_uuid: "84ce37420b064c329a78a263f4d45888" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36241 } } peers { permanent_uuid: "744d9d518afd4110b8e09a551af20917" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 39173 } }
I20260924 12:55:01.609140 23297 raft_consensus.cc:348] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20ca98656944f5b9b6af0fead2e065e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40281 } } peers { permanent_uuid: "84ce37420b064c329a78a263f4d45888" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36241 } } peers { permanent_uuid: "744d9d518afd4110b8e09a551af20917" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 39173 } }
I20260924 12:55:01.609723 23297 raft_consensus.cc:374] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:55:01.609845 23297 raft_consensus.cc:729] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ca98656944f5b9b6af0fead2e065e, State: Initialized, Role: FOLLOWER
I20260924 12:55:01.610657 23297 consensus_queue.cc:260] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20ca98656944f5b9b6af0fead2e065e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40281 } } peers { permanent_uuid: "84ce37420b064c329a78a263f4d45888" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36241 } } peers { permanent_uuid: "744d9d518afd4110b8e09a551af20917" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 39173 } }
I20260924 12:55:01.612329 23276 heartbeater.cc:503] Master 127.11.49.126:42683 was elected leader, sending a full tablet report...
I20260924 12:55:01.612655 23295 ts_tablet_manager.cc:1428] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: Time spent starting tablet: real 0.030s user 0.015s sys 0.006s
I20260924 12:55:01.613361 23297 ts_tablet_manager.cc:1428] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: Time spent starting tablet: real 0.019s user 0.013s sys 0.004s
W20260924 12:55:01.636590 23143 tablet.cc:2369] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:55:01.646528 23277 tablet.cc:2369] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:55:01.761159 23301 raft_consensus.cc:482] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:55:01.761713 23301 raft_consensus.cc:504] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20ca98656944f5b9b6af0fead2e065e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40281 } } peers { permanent_uuid: "84ce37420b064c329a78a263f4d45888" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36241 } } peers { permanent_uuid: "744d9d518afd4110b8e09a551af20917" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 39173 } }
I20260924 12:55:01.764647 23301 leader_election.cc:288] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20ca98656944f5b9b6af0fead2e065e (127.11.49.67:40281), 84ce37420b064c329a78a263f4d45888 (127.11.49.65:36241)
W20260924 12:55:01.765668 23002 tablet.cc:2369] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:55:01.779515 23291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.765842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:33781 (local address 127.11.49.65:36241)
0924 12:55:01.766072 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:01.766079 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:01.767262 (+ 1183us) server_negotiation.cc:407] Connection header received
0924 12:55:01.767551 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:01.767581 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:01.767705 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:01.767888 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:55:01.769378 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.771511 (+ 2133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.775420 (+ 3909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.777721 (+ 2301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.778157 (+ 436us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.778258 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:01.778989 (+ 731us) server_negotiation.cc:299] Negotiation successful
0924 12:55:01.779186 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260924 12:55:01.779510 23289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.765180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:59897 (local address 127.11.49.67:40281)
0924 12:55:01.765425 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:01.765431 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:01.767339 (+ 1908us) server_negotiation.cc:407] Connection header received
0924 12:55:01.767563 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:01.767578 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:01.767705 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:01.767888 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:55:01.769378 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.771511 (+ 2133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.775375 (+ 3864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.777695 (+ 2320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.778157 (+ 462us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.778258 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:01.778989 (+ 731us) server_negotiation.cc:299] Negotiation successful
0924 12:55:01.779186 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260924 12:55:01.779748 23304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.765638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:40281 (local address 127.11.49.66:59897)
0924 12:55:01.766988 (+ 1350us) negotiation.cc:107] Waiting for socket to connect
0924 12:55:01.767009 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:55:01.767244 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:55:01.767977 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:55:01.767984 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:55:01.768053 (+ 69us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:55:01.769039 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.769064 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.771816 (+ 2752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.771823 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.774895 (+ 3072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.774923 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.778290 (+ 3367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.778301 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.778620 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.778698 (+ 78us) client_negotiation.cc:769] Sending connection context
0924 12:55:01.778858 (+ 160us) client_negotiation.cc:240] Negotiation successful
0924 12:55:01.779061 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1225,"mutex_wait_us":423,"spinlock_wait_cycles":65280,"thread_start_us":840,"threads_started":1}
I20260924 12:55:01.779806 23305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.765127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36241 (local address 127.11.49.66:33781)
0924 12:55:01.766961 (+ 1834us) negotiation.cc:107] Waiting for socket to connect
0924 12:55:01.766988 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:55:01.767209 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:55:01.767977 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:55:01.767984 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:55:01.768053 (+ 69us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:55:01.769159 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.769172 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.771871 (+ 2699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.771879 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.774895 (+ 3016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:55:01.774923 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.778296 (+ 3373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.778301 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:55:01.778626 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.778698 (+ 72us) client_negotiation.cc:769] Sending connection context
0924 12:55:01.778858 (+ 160us) client_negotiation.cc:240] Negotiation successful
0924 12:55:01.779061 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1610,"mutex_wait_us":505,"spinlock_wait_cycles":52608,"thread_start_us":1610,"threads_started":1}
I20260924 12:55:01.782207 23231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2caab6bfd64a4c978e7c96192cca3eca" candidate_uuid: "744d9d518afd4110b8e09a551af20917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ca98656944f5b9b6af0fead2e065e" is_pre_election: true
I20260924 12:55:01.782207 22954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2caab6bfd64a4c978e7c96192cca3eca" candidate_uuid: "744d9d518afd4110b8e09a551af20917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84ce37420b064c329a78a263f4d45888" is_pre_election: true
I20260924 12:55:01.783059 22954 raft_consensus.cc:2454] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 744d9d518afd4110b8e09a551af20917 in term 0.
I20260924 12:55:01.783053 23231 raft_consensus.cc:2454] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 744d9d518afd4110b8e09a551af20917 in term 0.
I20260924 12:55:01.784215 23032 leader_election.cc:302] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 744d9d518afd4110b8e09a551af20917, 84ce37420b064c329a78a263f4d45888, f20ca98656944f5b9b6af0fead2e065e; no voters:
I20260924 12:55:01.785030 23301 raft_consensus.cc:2781] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:55:01.785300 23301 raft_consensus.cc:482] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:55:01.785477 23301 raft_consensus.cc:3037] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:55:01.789561 23301 raft_consensus.cc:504] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20ca98656944f5b9b6af0fead2e065e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40281 } } peers { permanent_uuid: "84ce37420b064c329a78a263f4d45888" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36241 } } peers { permanent_uuid: "744d9d518afd4110b8e09a551af20917" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 39173 } }
I20260924 12:55:01.790596 23301 leader_election.cc:288] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [CANDIDATE]: Term 1 election: Requested vote from peers f20ca98656944f5b9b6af0fead2e065e (127.11.49.67:40281), 84ce37420b064c329a78a263f4d45888 (127.11.49.65:36241)
I20260924 12:55:01.791525 23231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2caab6bfd64a4c978e7c96192cca3eca" candidate_uuid: "744d9d518afd4110b8e09a551af20917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ca98656944f5b9b6af0fead2e065e"
I20260924 12:55:01.791975 22954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2caab6bfd64a4c978e7c96192cca3eca" candidate_uuid: "744d9d518afd4110b8e09a551af20917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84ce37420b064c329a78a263f4d45888"
I20260924 12:55:01.792128 23231 raft_consensus.cc:3037] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:55:01.792479 22954 raft_consensus.cc:3037] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:55:01.795302 23231 raft_consensus.cc:2454] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744d9d518afd4110b8e09a551af20917 in term 1.
I20260924 12:55:01.796100 23031 leader_election.cc:302] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 744d9d518afd4110b8e09a551af20917, f20ca98656944f5b9b6af0fead2e065e; no voters:
I20260924 12:55:01.796202 22954 raft_consensus.cc:2454] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 744d9d518afd4110b8e09a551af20917 in term 1.
I20260924 12:55:01.796597 23301 raft_consensus.cc:2781] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:55:01.797358 23301 raft_consensus.cc:686] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 1 LEADER]: Becoming Leader. State: Replica: 744d9d518afd4110b8e09a551af20917, State: Running, Role: LEADER
I20260924 12:55:01.798110 23301 consensus_queue.cc:237] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20ca98656944f5b9b6af0fead2e065e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40281 } } peers { permanent_uuid: "84ce37420b064c329a78a263f4d45888" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36241 } } peers { permanent_uuid: "744d9d518afd4110b8e09a551af20917" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 39173 } }
I20260924 12:55:01.805387 22786 catalog_manager.cc:5495] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 reported cstate change: term changed from 0 to 1, leader changed from <none> to 744d9d518afd4110b8e09a551af20917 (127.11.49.66). New cstate: current_term: 1 leader_uuid: "744d9d518afd4110b8e09a551af20917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20ca98656944f5b9b6af0fead2e065e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84ce37420b064c329a78a263f4d45888" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "744d9d518afd4110b8e09a551af20917" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260924 12:55:01.841442 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.832971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40968 (local address 127.11.49.66:39173)
0924 12:55:01.833410 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:01.833416 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:01.833444 (+ 28us) server_negotiation.cc:407] Connection header received
0924 12:55:01.833796 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:01.833802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:01.833948 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:01.834126 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:55:01.834822 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.835650 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.837856 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.838492 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.838647 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.839799 (+ 1152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:55:01.840541 (+ 742us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:55:01.840672 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:01.841014 (+ 342us) server_negotiation.cc:299] Negotiation successful
0924 12:55:01.841100 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260924 12:55:01.853790 23231 raft_consensus.cc:1261] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e [term 1 FOLLOWER]: Refusing update from remote peer 744d9d518afd4110b8e09a551af20917: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:55:01.854252 22954 raft_consensus.cc:1261] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888 [term 1 FOLLOWER]: Refusing update from remote peer 744d9d518afd4110b8e09a551af20917: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:55:01.855844 23306 consensus_queue.cc:1035] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ca98656944f5b9b6af0fead2e065e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 40281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:55:01.856360 23301 consensus_queue.cc:1035] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84ce37420b064c329a78a263f4d45888" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:55:01.898370 22786 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:55:01.898813 22786 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:55:01.906627 22786 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e853cd6504949ff964d54c7943e1124: Sending DeleteTablet for 3 replicas of tablet 2caab6bfd64a4c978e7c96192cca3eca
I20260924 12:55:01.908655 23211 tablet_service.cc:1514] Processing DeleteTablet for tablet 2caab6bfd64a4c978e7c96192cca3eca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:55:01 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:33606
I20260924 12:55:01.908885 23077 tablet_service.cc:1514] Processing DeleteTablet for tablet 2caab6bfd64a4c978e7c96192cca3eca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:55:01 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:40966
I20260924 12:55:01.909065 22934 tablet_service.cc:1514] Processing DeleteTablet for tablet 2caab6bfd64a4c978e7c96192cca3eca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:55:01 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:50306
I20260924 12:55:01.912122 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 22866
I20260924 12:55:01.925000 23321 tablet_replica.cc:330] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: stopping tablet replica
I20260924 12:55:01.926025 23321 raft_consensus.cc:2229] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:55:01.927590 23321 raft_consensus.cc:2258] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:55:01.935693 23321 ts_tablet_manager.cc:1905] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:55:01.936741 23319 tablet_replica.cc:330] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: stopping tablet replica
I20260924 12:55:01.937158 23320 tablet_replica.cc:330] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: stopping tablet replica
I20260924 12:55:01.937762 23320 raft_consensus.cc:2229] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:55:01.938439 23320 raft_consensus.cc:2258] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:55:01.941437 23320 ts_tablet_manager.cc:1905] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:55:01.941923 23319 raft_consensus.cc:2229] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:55:01.942647 23319 raft_consensus.cc:2258] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:55:01.945657 23321 ts_tablet_manager.cc:1918] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:55:01.945890 23321 log.cc:1196] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/2caab6bfd64a4c978e7c96192cca3eca
I20260924 12:55:01.946508 23321 ts_tablet_manager.cc:1939] T 2caab6bfd64a4c978e7c96192cca3eca P 744d9d518afd4110b8e09a551af20917: Deleting consensus metadata
I20260924 12:55:01.948819 23319 ts_tablet_manager.cc:1905] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:55:01.948828 22772 catalog_manager.cc:4841] TS 744d9d518afd4110b8e09a551af20917 (127.11.49.66:39173): tablet 2caab6bfd64a4c978e7c96192cca3eca (table test-table [id=06cc8caab69b403bb4e818ddd1d2c853]) successfully deleted
Sep 24 12:55:01 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:55:01.953617 23320 ts_tablet_manager.cc:1918] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:55:01.953888 23320 log.cc:1196] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/2caab6bfd64a4c978e7c96192cca3eca
I20260924 12:55:01.954586 23320 ts_tablet_manager.cc:1939] T 2caab6bfd64a4c978e7c96192cca3eca P 84ce37420b064c329a78a263f4d45888: Deleting consensus metadata
I20260924 12:55:01.957491 22772 catalog_manager.cc:4841] TS 84ce37420b064c329a78a263f4d45888 (127.11.49.65:36241): tablet 2caab6bfd64a4c978e7c96192cca3eca (table test-table [id=06cc8caab69b403bb4e818ddd1d2c853]) successfully deleted
I20260924 12:55:01.957641 23319 ts_tablet_manager.cc:1918] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:55:01.957868 23319 log.cc:1196] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/2caab6bfd64a4c978e7c96192cca3eca
I20260924 12:55:01.958385 23319 ts_tablet_manager.cc:1939] T 2caab6bfd64a4c978e7c96192cca3eca P f20ca98656944f5b9b6af0fead2e065e: Deleting consensus metadata
I20260924 12:55:01.960646 22771 catalog_manager.cc:4841] TS f20ca98656944f5b9b6af0fead2e065e (127.11.49.67:40281): tablet 2caab6bfd64a4c978e7c96192cca3eca (table test-table [id=06cc8caab69b403bb4e818ddd1d2c853]) successfully deleted
I20260924 12:55:01.963279 23291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:01.914688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50312 (local address 127.11.49.65:36241)
0924 12:55:01.914996 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:01.915007 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:01.923271 (+ 8264us) server_negotiation.cc:407] Connection header received
0924 12:55:01.923612 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:01.923623 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:01.923779 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:01.923981 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:55:01.937142 (+ 13161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.938504 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.943249 (+ 4745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:01.943966 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:01.944112 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:01.953156 (+ 9044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:55:01.953185 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:55:01.953227 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:55:01.953295 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:55:01.959017 (+ 5722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:01.960133 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:01.960143 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:01.960145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:01.960408 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:01.960952 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:01.960958 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:01.960962 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:01.961444 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:55:01.961702 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:01.962502 (+ 800us) server_negotiation.cc:299] Negotiation successful
0924 12:55:01.962862 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260924 12:55:01.964323 22994 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:55:02.071368 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 22866
I20260924 12:55:02.091550 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 23005
Sep 24 12:55:02 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:55:02.115232 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:02.092526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40974 (local address 127.11.49.66:39173)
0924 12:55:02.092792 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:02.092799 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:02.092830 (+ 31us) server_negotiation.cc:407] Connection header received
0924 12:55:02.092931 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:02.092938 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:02.093057 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:02.093224 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:55:02.094741 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:02.096356 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:02.097943 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:02.098793 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:02.099007 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:02.104991 (+ 5984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:55:02.105014 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:55:02.105036 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:55:02.105115 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:55:02.110392 (+ 5277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:02.111713 (+ 1321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:02.111727 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:02.111731 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:02.112075 (+ 344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:02.112765 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:02.112771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:02.112775 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:02.113495 (+ 720us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:55:02.113950 (+ 455us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:02.114429 (+ 479us) server_negotiation.cc:299] Negotiation successful
0924 12:55:02.114759 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260924 12:55:02.116349 23137 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:55:02.258908 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 23005
I20260924 12:55:02.279469 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 23148
Sep 24 12:55:02 dist-test-slave-m9hg krb5kdc[22310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:55:02.303841 23325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:55:02.280580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33614 (local address 127.11.49.67:40281)
0924 12:55:02.281228 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0924 12:55:02.281234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:55:02.281256 (+ 22us) server_negotiation.cc:407] Connection header received
0924 12:55:02.281331 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:55:02.281335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:55:02.281411 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:55:02.281555 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:55:02.282973 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:02.283896 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:02.285692 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:55:02.286220 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:55:02.286360 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:55:02.292428 (+ 6068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:55:02.292460 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:55:02.292488 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:55:02.292571 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:55:02.299582 (+ 7011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:02.301101 (+ 1519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:02.301110 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:02.301113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:02.301315 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:55:02.301903 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:55:02.301908 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:55:02.301910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:55:02.302405 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:55:02.302682 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0924 12:55:02.303139 (+ 457us) server_negotiation.cc:299] Negotiation successful
0924 12:55:02.303399 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":326,"threads_started":1}
I20260924 12:55:02.304833 23271 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:55:02.415398 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 23148
I20260924 12:55:02.432832 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 22754
I20260924 12:55:02.434366 22816 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:55:02.554382 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 22754
I20260924 12:55:02.584491 11461 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260924 12:55:02.932329 11461 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260924 12:55:02.932633 11461 mini_ranger.cc:66] Stopping Ranger...
I20260924 12:55:03.280735 11461 mini_ranger.cc:68] Stopped Ranger
2026-09-24 12:55:03.281 UTC [22340] LOG: received smart shutdown request
2026-09-24 12:55:03.285 UTC [22340] LOG: background worker "logical replication launcher" (PID 22349) exited with exit code 1
2026-09-24 12:55:03.286 UTC [22344] LOG: shutting down
2026-09-24 12:55:03.524 UTC [22340] LOG: database system is shut down
2026-09-24T12:55:03Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (63734 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:55:03 dist-test-slave-m9hg krb5kdc[23336](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:55:03 dist-test-slave-m9hg krb5kdc[23336](info): set up 2 sockets
Sep 24 12:55:03 dist-test-slave-m9hg krb5kdc[23336](info): commencing operation
krb5kdc: starting...
W20260924 12:55:04.889847 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.001s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:55:05 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:55:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:55:05Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.49.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.49.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/rangeradmin_127.11.49.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/rangeradmin_127.11.49.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.49.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.49.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/rangerlookup_127.11.49.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/rangerlookup_127.11.49.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.49.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.49.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/HTTP_127.11.49.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/HTTP_127.11.49.84@KRBTEST.COM.keytab.
I20260924 12:55:05.317123 11461 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskvGPshr/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/postgres -l logfile start
2026-09-24 12:55:08.954 UTC [23366] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-24 12:55:08.954 UTC [23366] LOG: listening on IPv4 address "127.11.49.84", port 45095
2026-09-24 12:55:08.962 UTC [23366] LOG: listening on Unix socket "/tmp/.s.PGSQL.45095"
2026-09-24 12:55:08.996 UTC [23369] LOG: database system was shut down at 2026-09-24 12:55:06 UTC
2026-09-24 12:55:09.004 UTC [23366] LOG: database system is ready to accept connections
I20260924 12:55:10.053467 11461 mini_postgres.cc:96] Postgres bound to 45095
2026-09-24 12:55:10.077 UTC [23377] FATAL: database "slave" does not exist
127.11.49.84:45095 - accepting connections
I20260924 12:55:10.078167 11461 mini_ranger.cc:161] Starting Ranger...
I20260924 12:55:10.114533 11461 mini_ranger.cc:84] Created miniranger Postgres user
I20260924 12:55:10.936167 11461 mini_ranger.cc:87] Created ranger Postgres database
I20260924 12:55:10.936445 11461 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-admin
2026-09-24 12:55:11,247 [I] DB FLAVOR :POSTGRES
2026-09-24 12:55:11,247 [I] --------- Verifying Ranger DB connection ---------
2026-09-24 12:55:11,247 [I] Checking connection..
2026-09-24 12:55:11,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-24 12:55:11,552 [I] Checking connection passed.
2026-09-24 12:55:11,553 [I] --------- Verifying version history table ---------
2026-09-24 12:55:11,553 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 12:55:11,852 [I] Table x_db_version_h does not exist in database ranger
2026-09-24 12:55:11,852 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 12:55:12,140 [I] Table x_db_version_h does not exist in database ranger
2026-09-24 12:55:12,140 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-24 12:55:12,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-24 12:55:12.446 UTC [23441] WARNING: there is no transaction in progress
2026-09-24 12:55:12,454 [I] create_dbversion_catalog.sql file imported successfully
2026-09-24 12:55:12,455 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 12:55:12,796 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-24 12:55:12,796 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-24 12:55:12,797 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-24 12:55:13,112 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-24 12:55:13,429 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-m9hg.c.gcp-upstream.internal','N') ;"
2026-09-24 12:55:13,754 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-24 12:55:14,052 [I] Table x_portal_user does not exist in database ranger
2026-09-24 12:55:14,053 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-24 12:55:14,371 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-24 12:55:14,371 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-24 12:55:14,652 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-24 12:55:14,934 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-24 12:55:14,934 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-24 12:55:16.275 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.301 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.325 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.349 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.372 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.398 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.471 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.482 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.501 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.514 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.526 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.545 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.562 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.576 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.588 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:16.603 UTC [23549] WARNING: there is no transaction in progress
2026-09-24 12:55:17,791 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-24 12:55:17,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-24 12:55:18,066 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-24 12:55:18,067 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-24 12:55:18,365 [I] Table x_portal_user already exists in database 'ranger'
2026-09-24 12:55:18,365 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-24 12:55:18,698 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-24 12:55:18,699 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-24 12:55:19,035 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-24 12:55:19,396 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-m9hg.c.gcp-upstream.internal';"
2026-09-24 12:55:19,730 [I] CORE_DB_SCHEMA import status has been updated
2026-09-24 12:55:19,731 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-24 12:55:20,047 [I] DB_PATCHES have already been applied
I20260924 12:55:20.055331 11461 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-admin:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskvGPshr/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260924 12:55:20.055454 11461 mini_ranger.cc:193] Using host: 127.11.49.84
I20260924 12:55:20.076674 11461 mini_ranger.cc:227] Ranger admin URL: http://127.11.49.84:38365
Sep 24, 2026 12:55:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 24, 2026 12:55:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 24, 2026 12:55:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-admin/ews/webapp
Sep 24, 2026 12:55:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 24, 2026 12:55:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 24, 2026 12:55:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-admin/ews/webapp].
Sep 24, 2026 12:55:21 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260924 12:55:21.335790 11461 mini_ranger.cc:160] Time spent starting Ranger: real 11.258s user 0.000s sys 0.057s
Sep 24, 2026 12:55:47 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 24, 2026 12:55:47 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Sep 24, 2026 12:55:47 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 24, 2026 12:55:47 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 24, 2026 12:55:48 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260924 12:55:49.282498 11461 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.49.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.49.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/rangerkms_127.11.49.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.49.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/rangerkms_127.11.49.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.49.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.49.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.49.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/HTTP_127.11.49.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.49.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/HTTP_127.11.49.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 24 12:55:49 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254549, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260924 12:55:49.488478 11461 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260924 12:55:49.517098 11461 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260924 12:55:50.700743 11461 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260924 12:55:50.700891 11461 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-kms
I20260924 12:55:50.700939 11461 mini_ranger_kms.cc:227] Using postgres at 127.11.49.84:45095
2026-09-24 12:55:51,119 [I] DB FLAVOR :POSTGRES
2026-09-24 12:55:51,119 [I] --------- Verifying Ranger DB connection ---------
2026-09-24 12:55:51,119 [I] Checking connection
2026-09-24 12:55:51,119 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-24 12:55:51,433 [I] connection success
2026-09-24 12:55:51,433 [I] --------- Verifying Ranger DB tables ---------
2026-09-24 12:55:51,433 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-24 12:55:51,433 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-24 12:55:51,745 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-24 12:55:51,745 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-24 12:55:51,745 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-24 12:55:51,745 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.49.84:45095/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-24 12:55:52,042 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260924 12:55:52.668874 11461 mini_ranger_kms.cc:310] Created kms service
I20260924 12:55:52.903824 11461 mini_ranger_kms.cc:326] Created kudu user
I20260924 12:55:52.978252 11461 mini_ranger_kms.cc:343] Created rangerkms user
Sep 24 12:55:52 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254549, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:55:53.560640 11461 mini_ranger_kms.cc:384] Added ranger policy
I20260924 12:55:53.561267 11461 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-kms:/tmp/dist-test-taskvGPshr/build/asan/bin/postgresql.jar:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskvGPshr/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260924 12:55:53.561405 11461 mini_ranger_kms.cc:240] Using host: 127.11.49.84
I20260924 12:55:53.585568 11461 mini_ranger_kms.cc:276] Ranger KMS PID: 23730
I20260924 12:55:53.585988 11461 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.49.84:38431
Sep 24, 2026 12:55:54 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 24, 2026 12:55:54 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 24, 2026 12:55:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 24, 2026 12:55:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 24, 2026 12:55:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-kms/ews/webapp].
Sep 24, 2026 12:55:55 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260924 12:55:56.056823 11461 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.568s user 0.100s sys 0.338s
I20260924 12:55:56.057163 11461 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260924 12:55:56.057381 11461 mini_ranger_kms.cc:401] 127.11.49.84:38431/kms/v1/keys
Sep 24 12:55:56 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790254556, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.49.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 24 12:55:57 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254556, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.49.84@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
Sep 24 12:55:57 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254556, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.49.84@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
Sep 24 12:56:00 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:56:00.490947 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:43915
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:43915
--ranger_config_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:38431/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:00.850343 23780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:00.850677 23780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:00.850780 23780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:00.858510 23780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:56:00.858651 23780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:00.858700 23780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:00.858749 23780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:56:00.858805 23780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:56:00.869587 23780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.49.84:38431/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:43915
--ranger_config_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:43915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:00.870934 23780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:00.872260 23780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:00.886494 23788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:00.886646 23785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:00.886574 23786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:00.887217 23780 server_base.cc:1034] running on GCE node
I20260924 12:56:00.888149 23780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:00.889890 23780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:00.891104 23780 hybrid_clock.cc:648] HybridClock initialized: now 1790254560891051 us; error 60 us; skew 500 ppm
I20260924 12:56:00.891455 23780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:00 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254560, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:00.894819 23780 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:56:00.896694 23780 webserver.cc:460] Webserver started at http://127.11.49.126:40515/ using document root <none> and password file <none>
I20260924 12:56:00.897354 23780 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:00.897464 23780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:00.897739 23780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 12:56:00 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254560, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:56:00.953622 23780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "921c628c2f9e402daaea90376cac88a8"
format_stamp: "Formatted at 2026-09-24 12:56:00 on dist-test-slave-m9hg"
server_key: "575d396e179f4f9034dcc5cce9ad43e9"
server_key_iv: "2e766ee33971be4e3f877f3faf4223fb"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:00.954567 23780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "921c628c2f9e402daaea90376cac88a8"
format_stamp: "Formatted at 2026-09-24 12:56:00 on dist-test-slave-m9hg"
server_key: "575d396e179f4f9034dcc5cce9ad43e9"
server_key_iv: "2e766ee33971be4e3f877f3faf4223fb"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:00.960789 23780 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260924 12:56:00.979583 23795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:00.981251 23780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260924 12:56:00.981472 23780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "921c628c2f9e402daaea90376cac88a8"
format_stamp: "Formatted at 2026-09-24 12:56:00 on dist-test-slave-m9hg"
server_key: "575d396e179f4f9034dcc5cce9ad43e9"
server_key_iv: "2e766ee33971be4e3f877f3faf4223fb"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:00.981714 23780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:01.007392 23780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:01.013072 23780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:01.013499 23780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:01.037247 23780 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:43915
I20260924 12:56:01.037251 23846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:43915 every 8 connection(s)
I20260924 12:56:01.038774 23780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:56:01.043159 23847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:01.044641 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 23780
I20260924 12:56:01.044936 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:56:01.046034 11461 external_mini_cluster.cc:1428] Setting key 7d7713443db565ba1ef6efe6c38769c3
I20260924 12:56:01.061936 23847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8: Bootstrap starting.
I20260924 12:56:01.066740 23847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:01.068205 23847 log.cc:824] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:01.072178 23847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8: No bootstrap required, opened a new log
Sep 24 12:56:01 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:01.083019 23847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } }
I20260924 12:56:01.083606 23847 raft_consensus.cc:374] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:01.083730 23847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 921c628c2f9e402daaea90376cac88a8, State: Initialized, Role: FOLLOWER
I20260924 12:56:01.084594 23847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } }
I20260924 12:56:01.084914 23847 raft_consensus.cc:388] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:56:01.085106 23847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:56:01.085386 23847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:01.088691 23850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:01.049559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44118 (local address 127.11.49.126:43915)
0924 12:56:01.064002 (+ 14443us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:01.064025 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:01.064095 (+ 70us) server_negotiation.cc:407] Connection header received
0924 12:56:01.066809 (+ 2714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:01.066841 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:01.067446 (+ 605us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:01.067978 (+ 532us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:01.069646 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:01.071060 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:01.072565 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:01.073627 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:01.073953 (+ 326us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:01.079074 (+ 5121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:01.079085 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:01.079109 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:01.079177 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:01.082951 (+ 3774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:01.084005 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:01.084014 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:01.084021 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:01.084313 (+ 292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:01.084854 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:01.084860 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:01.084864 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:01.085904 (+ 1040us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:01.086331 (+ 427us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:01.086942 (+ 611us) server_negotiation.cc:299] Negotiation successful
0924 12:56:01.087479 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14081,"thread_start_us":13819,"threads_started":1}
I20260924 12:56:01.088793 23847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } }
I20260924 12:56:01.089599 23847 leader_election.cc:302] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 921c628c2f9e402daaea90376cac88a8; no voters:
I20260924 12:56:01.090432 23847 leader_election.cc:288] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:56:01.090631 23852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:56:01.091459 23852 raft_consensus.cc:686] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 1 LEADER]: Becoming Leader. State: Replica: 921c628c2f9e402daaea90376cac88a8, State: Running, Role: LEADER
I20260924 12:56:01.092154 23852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } }
I20260924 12:56:01.094560 23853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 921c628c2f9e402daaea90376cac88a8. Latest consensus state: current_term: 1 leader_uuid: "921c628c2f9e402daaea90376cac88a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } } }
I20260924 12:56:01.095046 23853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:01.095955 23847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:56:01.095778 23854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "921c628c2f9e402daaea90376cac88a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } } }
I20260924 12:56:01.096427 23854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:01.099648 23856 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:56:01.109527 23856 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:56:01.112979 23847 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260924 12:56:01.140156 23856 catalog_manager.cc:1347] Generated new cluster ID: a31bf466676a4a28b6caedc2ffda5525
I20260924 12:56:01.140547 23856 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:56:01.191509 23856 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:56:01.194085 23856 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:56:01.216336 23856 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8: Generated new TSK 0
I20260924 12:56:01.218017 23856 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:56:02.166693 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:38431/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:43915
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:56:02 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790254562, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260924 12:56:02.708102 23892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:02.708747 23892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:02.708949 23892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:02.723294 23892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:02.723646 23892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:02.723907 23892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:56:02.742952 23892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.49.84:38431/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:43915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:02.745425 23892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:02.747865 23892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:02.768090 23902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:02.767841 23903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:02.768747 23905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:02.770073 23892 server_base.cc:1034] running on GCE node
I20260924 12:56:02.771239 23892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:02.773039 23892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:02.774346 23892 hybrid_clock.cc:648] HybridClock initialized: now 1790254562774264 us; error 92 us; skew 500 ppm
I20260924 12:56:02.774863 23892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:02 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254562, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:02.786196 23892 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:56:02.793051 23892 webserver.cc:460] Webserver started at http://127.11.49.65:42449/ using document root <none> and password file <none>
I20260924 12:56:02.793931 23892 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:02.794103 23892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:02.794669 23892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 12:56:02 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254562, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:56:02.816851 23892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "2351acab904b4a9db8d2c9f8f52e851e"
format_stamp: "Formatted at 2026-09-24 12:56:02 on dist-test-slave-m9hg"
server_key: "89a392af6617195891a6d4d076f26832"
server_key_iv: "9f52f86e305396585fdfcef3d91801d1"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:02.818178 23892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "2351acab904b4a9db8d2c9f8f52e851e"
format_stamp: "Formatted at 2026-09-24 12:56:02 on dist-test-slave-m9hg"
server_key: "89a392af6617195891a6d4d076f26832"
server_key_iv: "9f52f86e305396585fdfcef3d91801d1"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:02.849926 23892 fs_manager.cc:691] Time spent creating directory manager: real 0.031s user 0.015s sys 0.015s
I20260924 12:56:02.879426 23912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:02.882220 23892 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.002s sys 0.008s
I20260924 12:56:02.882596 23892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "2351acab904b4a9db8d2c9f8f52e851e"
format_stamp: "Formatted at 2026-09-24 12:56:02 on dist-test-slave-m9hg"
server_key: "89a392af6617195891a6d4d076f26832"
server_key_iv: "9f52f86e305396585fdfcef3d91801d1"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:02.882952 23892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:02.932348 23892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:02.939935 23892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:02.940483 23892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:02.948639 23892 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:02.958137 23892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:02.958316 23892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:02.958513 23892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:02.958607 23892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 12:56:03 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254562, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:56:03.320907 23892 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:45491
I20260924 12:56:03.321055 24024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:45491 every 8 connection(s)
I20260924 12:56:03.322973 23892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:56:03.326682 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 23892
I20260924 12:56:03.326928 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:56:03.327847 11461 external_mini_cluster.cc:1428] Setting key a389b8854c3d3372bb8cfefa5cd84218
Sep 24 12:56:03 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254562, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
I20260924 12:56:03.374802 24027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:03.328890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:43915 (local address 127.11.49.65:53583)
0924 12:56:03.345720 (+ 16830us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:03.345821 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:03.350482 (+ 4661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:03.351755 (+ 1273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:03.351770 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:03.352534 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:03.353472 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:03.353499 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:03.355103 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:03.355108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:03.357331 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:03.357371 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:03.358727 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:03.358748 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:03.359058 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:03.360374 (+ 1316us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:03.360407 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:03.363498 (+ 3091us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:03.368146 (+ 4648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:03.368157 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:03.368178 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:03.369129 (+ 951us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:03.369851 (+ 722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:03.369857 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:03.369861 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:03.370186 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:03.371170 (+ 984us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:03.371182 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:03.371859 (+ 677us) client_negotiation.cc:769] Sending connection context
0924 12:56:03.372300 (+ 441us) client_negotiation.cc:240] Negotiation successful
0924 12:56:03.373011 (+ 711us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16369,"thread_start_us":16045,"threads_started":1}
I20260924 12:56:03.376856 24028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:03.329844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:53583 (local address 127.11.49.126:43915)
0924 12:56:03.349479 (+ 19635us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:03.349487 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:03.349519 (+ 32us) server_negotiation.cc:407] Connection header received
0924 12:56:03.351009 (+ 1490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:03.351016 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:03.351113 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:03.351228 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:03.353694 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:03.354901 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:03.357575 (+ 2674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:03.358235 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:03.358376 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:03.363872 (+ 5496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:03.363881 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:03.363886 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:03.363933 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:03.367914 (+ 3981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:03.369405 (+ 1491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:03.369415 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:03.369418 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:03.369665 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:03.370369 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:03.370375 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:03.370379 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:03.370849 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:03.371036 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:03.376025 (+ 4989us) server_negotiation.cc:299] Negotiation successful
0924 12:56:03.376417 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19449,"thread_start_us":19284,"threads_started":1}
I20260924 12:56:03.378991 24025 heartbeater.cc:347] Connected to a master server at 127.11.49.126:43915
I20260924 12:56:03.379436 24025 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:03.380630 24025 heartbeater.cc:511] Master 127.11.49.126:43915 requested a full tablet report, sending...
I20260924 12:56:03.384723 23812 ts_manager.cc:194] Registered new tserver with Master: 2351acab904b4a9db8d2c9f8f52e851e (127.11.49.65:45491)
I20260924 12:56:03.387422 23812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:53583
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:56:03.408670 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:38431/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:43915
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:56:03 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254562, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
W20260924 12:56:03.924631 24031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:03.925010 24031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:03.925192 24031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:03.933732 24031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:03.933911 24031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:03.934108 24031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:56:03.946062 24031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.49.84:38431/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:43915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:03.947510 24031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:03.948971 24031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:03.965080 24045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:03.965157 24046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:03.965688 24048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:03.967171 24031 server_base.cc:1034] running on GCE node
I20260924 12:56:03.968039 24031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:03.969328 24031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:03.970592 24031 hybrid_clock.cc:648] HybridClock initialized: now 1790254563970554 us; error 60 us; skew 500 ppm
I20260924 12:56:03.971009 24031 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:03 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254563, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:03.974943 24031 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:56:03.976974 24031 webserver.cc:460] Webserver started at http://127.11.49.66:43933/ using document root <none> and password file <none>
I20260924 12:56:03.977753 24031 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:03.977912 24031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:03.978241 24031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 12:56:03 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254563, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:56:04.003720 24031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "abca6dd5ad454915a1b7417681700c3c"
format_stamp: "Formatted at 2026-09-24 12:56:03 on dist-test-slave-m9hg"
server_key: "08fab57a757f1a403162c7a8bd56966a"
server_key_iv: "045732e3b09abe3b5bb832a1d28a343f"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:04.004971 24031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "abca6dd5ad454915a1b7417681700c3c"
format_stamp: "Formatted at 2026-09-24 12:56:03 on dist-test-slave-m9hg"
server_key: "08fab57a757f1a403162c7a8bd56966a"
server_key_iv: "045732e3b09abe3b5bb832a1d28a343f"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:04.012356 24031 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.004s
I20260924 12:56:04.033255 24055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:04.035523 24031 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260924 12:56:04.035815 24031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "abca6dd5ad454915a1b7417681700c3c"
format_stamp: "Formatted at 2026-09-24 12:56:03 on dist-test-slave-m9hg"
server_key: "08fab57a757f1a403162c7a8bd56966a"
server_key_iv: "045732e3b09abe3b5bb832a1d28a343f"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:04.036119 24031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:04.071487 24031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:04.077221 24031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:04.077569 24031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:04.078941 24031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:04.081061 24031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:04.081172 24031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:04.081300 24031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:04.081386 24031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:04.161031 24031 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:38223
I20260924 12:56:04.161266 24167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:38223 every 8 connection(s)
I20260924 12:56:04.162838 24031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:56:04.163403 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 24031
I20260924 12:56:04.163612 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:56:04.164703 11461 external_mini_cluster.cc:1428] Setting key 22d09f505f55306a1b48ed82977cbc40
Sep 24 12:56:04 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254563, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
I20260924 12:56:04.222509 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:04.183524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:36949 (local address 127.11.49.126:43915)
0924 12:56:04.190268 (+ 6744us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:04.190277 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:04.190318 (+ 41us) server_negotiation.cc:407] Connection header received
0924 12:56:04.192688 (+ 2370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:04.192697 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:04.192841 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:04.193023 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:04.198581 (+ 5558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:04.201172 (+ 2591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:04.205018 (+ 3846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:04.205683 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:04.205824 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:04.212002 (+ 6178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:04.212012 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:04.212016 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:04.212074 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:04.217307 (+ 5233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:04.218748 (+ 1441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:04.218756 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:04.218760 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:04.218993 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:04.219673 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:04.219679 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:04.219682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:04.220120 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:04.220324 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:04.221607 (+ 1283us) server_negotiation.cc:299] Negotiation successful
0924 12:56:04.221973 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6446,"thread_start_us":6292,"threads_started":1}
I20260924 12:56:04.226131 24172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:04.184468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:43915 (local address 127.11.49.66:36949)
0924 12:56:04.187699 (+ 3231us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:04.187903 (+ 204us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:04.191906 (+ 4003us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:04.194152 (+ 2246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:04.194172 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:04.195261 (+ 1089us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:04.197882 (+ 2621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:04.197946 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:04.201627 (+ 3681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:04.201634 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:04.204619 (+ 2985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:04.204670 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:04.206353 (+ 1683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:04.206362 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:04.206767 (+ 405us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:04.207951 (+ 1184us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:04.207991 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:04.211531 (+ 3540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:04.217659 (+ 6128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:04.217674 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:04.217701 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:04.218528 (+ 827us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:04.219168 (+ 640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:04.219173 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:04.219176 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:04.219528 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:04.220444 (+ 916us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:04.220454 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:04.221057 (+ 603us) client_negotiation.cc:769] Sending connection context
0924 12:56:04.222830 (+ 1773us) client_negotiation.cc:240] Negotiation successful
0924 12:56:04.223994 (+ 1164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2666,"thread_start_us":2174,"threads_started":1}
I20260924 12:56:04.229754 24168 heartbeater.cc:347] Connected to a master server at 127.11.49.126:43915
I20260924 12:56:04.230289 24168 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:04.231556 24168 heartbeater.cc:511] Master 127.11.49.126:43915 requested a full tablet report, sending...
I20260924 12:56:04.234727 23812 ts_manager.cc:194] Registered new tserver with Master: abca6dd5ad454915a1b7417681700c3c (127.11.49.66:38223)
I20260924 12:56:04.236322 23812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:36949
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:56:04.269863 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:38431/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:43915
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:56:04.394241 24025 heartbeater.cc:503] Master 127.11.49.126:43915 was elected leader, sending a full tablet report...
W20260924 12:56:04.713474 24174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:04.713896 24174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:04.714007 24174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:04.722611 24174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:04.722784 24174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:04.722994 24174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:56:04.735177 24174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.49.84:38431/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:43915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:04.737181 24174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:04.738895 24174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:04.757789 24180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:04.757740 24182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:04.757856 24179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:04.762570 24174 server_base.cc:1034] running on GCE node
I20260924 12:56:04.763553 24174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:04.764977 24174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:04.766283 24174 hybrid_clock.cc:648] HybridClock initialized: now 1790254564766236 us; error 53 us; skew 500 ppm
I20260924 12:56:04.766726 24174 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:04 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254564, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:04.770540 24174 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:56:04.772627 24174 webserver.cc:460] Webserver started at http://127.11.49.67:45269/ using document root <none> and password file <none>
I20260924 12:56:04.773478 24174 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:04.773598 24174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:04.774019 24174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 12:56:04 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254564, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:56:04.792447 24174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "4440047715ec49bba93ee3f5433d082a"
format_stamp: "Formatted at 2026-09-24 12:56:04 on dist-test-slave-m9hg"
server_key: "5c249113e7c8f7f03c9d3cbdd973e61b"
server_key_iv: "9c4eabe27f91c58da3298a00937f9061"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:04.793715 24174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "4440047715ec49bba93ee3f5433d082a"
format_stamp: "Formatted at 2026-09-24 12:56:04 on dist-test-slave-m9hg"
server_key: "5c249113e7c8f7f03c9d3cbdd973e61b"
server_key_iv: "9c4eabe27f91c58da3298a00937f9061"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:04.801201 24174 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260924 12:56:04.818995 24189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:04.820745 24174 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260924 12:56:04.820912 24174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "4440047715ec49bba93ee3f5433d082a"
format_stamp: "Formatted at 2026-09-24 12:56:04 on dist-test-slave-m9hg"
server_key: "5c249113e7c8f7f03c9d3cbdd973e61b"
server_key_iv: "9c4eabe27f91c58da3298a00937f9061"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:04.821121 24174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:04.843370 24174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:04.849041 24174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:04.849432 24174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:04.850605 24174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:04.852380 24174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:04.852484 24174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260924 12:56:04.852641 24174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:04.852720 24174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:04.899165 24174 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:39171
I20260924 12:56:04.899298 24301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:39171 every 8 connection(s)
I20260924 12:56:04.900759 24174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:56:04.910728 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 24174
I20260924 12:56:04.910983 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:56:04.911792 11461 external_mini_cluster.cc:1428] Setting key 760ebb39cde2ddda16b71697f359cc31
Sep 24 12:56:04 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254564, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:04.929011 24304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:04.904493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:46867 (local address 127.11.49.126:43915)
0924 12:56:04.905308 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:04.905318 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:04.906059 (+ 741us) server_negotiation.cc:407] Connection header received
0924 12:56:04.908719 (+ 2660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:04.908726 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:04.908840 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:04.908988 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:04.911433 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:04.912724 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:04.915313 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:04.915875 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:04.916038 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:04.920579 (+ 4541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:04.920586 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:04.920590 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:04.920643 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:04.924782 (+ 4139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:04.925941 (+ 1159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:04.925950 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:04.925959 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:04.926129 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:04.926661 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:04.926668 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:04.926671 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:04.927071 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:04.927261 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:04.928186 (+ 925us) server_negotiation.cc:299] Negotiation successful
0924 12:56:04.928593 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":437,"threads_started":1}
I20260924 12:56:04.930321 24305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:04.904886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:43915 (local address 127.11.49.67:46867)
0924 12:56:04.905813 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:04.905876 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:04.907982 (+ 2106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:04.909383 (+ 1401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:04.909395 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:04.910041 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:04.911081 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:04.911123 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:04.913064 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:04.913071 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:04.915107 (+ 2036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:04.915141 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:04.916192 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:04.916201 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:04.916599 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:04.917494 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:04.917524 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:04.920142 (+ 2618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:04.925047 (+ 4905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:04.925068 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:04.925091 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:04.925757 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:04.926275 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:04.926280 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:04.926284 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:04.926532 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:04.927223 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:04.927234 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:04.927724 (+ 490us) client_negotiation.cc:769] Sending connection context
0924 12:56:04.928088 (+ 364us) client_negotiation.cc:240] Negotiation successful
0924 12:56:04.928845 (+ 757us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":372,"threads_started":1}
I20260924 12:56:04.932296 24302 heartbeater.cc:347] Connected to a master server at 127.11.49.126:43915
I20260924 12:56:04.932718 24302 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:04.933712 24302 heartbeater.cc:511] Master 127.11.49.126:43915 requested a full tablet report, sending...
I20260924 12:56:04.936075 23812 ts_manager.cc:194] Registered new tserver with Master: 4440047715ec49bba93ee3f5433d082a (127.11.49.67:39171)
I20260924 12:56:04.937100 23812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:46867
I20260924 12:56:04.941619 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:56:04.943717 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 23892
Sep 24 12:56:04 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:56:04.965903 24307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:04.944977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37932 (local address 127.11.49.65:45491)
0924 12:56:04.945738 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:04.945748 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:04.945783 (+ 35us) server_negotiation.cc:407] Connection header received
0924 12:56:04.945867 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:04.945874 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:04.946170 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:04.946369 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:04.948335 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:04.949567 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:04.951835 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:04.952735 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:04.952959 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:04.957668 (+ 4709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:04.957693 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:04.957714 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:04.957779 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:04.962014 (+ 4235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:04.963214 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:04.963224 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:04.963227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:04.963417 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:04.963925 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:04.963929 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:04.963931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:04.964474 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:04.964720 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:04.965175 (+ 455us) server_negotiation.cc:299] Negotiation successful
0924 12:56:04.965437 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":382,"threads_started":1}
I20260924 12:56:04.967736 24020 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:05.065444 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 23892
I20260924 12:56:05.084688 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 24031
Sep 24 12:56:05 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:56:05.105536 24309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:05.086163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45916 (local address 127.11.49.66:38223)
0924 12:56:05.086825 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:05.086833 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:05.086891 (+ 58us) server_negotiation.cc:407] Connection header received
0924 12:56:05.086988 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:05.086995 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:05.087248 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:05.087405 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:05.089209 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:05.090311 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:05.091996 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:05.092760 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:05.092913 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:05.098938 (+ 6025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:05.098954 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:05.098970 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:05.099014 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:05.102345 (+ 3331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:05.103212 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:05.103220 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:05.103223 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:05.103372 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:05.103766 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:05.103772 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:05.103775 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:05.104145 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:05.104464 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:05.104831 (+ 367us) server_negotiation.cc:299] Negotiation successful
0924 12:56:05.105115 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":348,"threads_started":1}
I20260924 12:56:05.106833 24163 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:05.202754 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 24031
I20260924 12:56:05.219056 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 24174
Sep 24 12:56:05 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:56:05.241827 24311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:05.220368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36894 (local address 127.11.49.67:39171)
0924 12:56:05.221220 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:05.221230 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:05.221270 (+ 40us) server_negotiation.cc:407] Connection header received
0924 12:56:05.221381 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:05.221389 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:05.221682 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:05.221862 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:05.223520 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:05.224896 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:05.226412 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:05.227175 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:05.227346 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:05.232924 (+ 5578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:05.232979 (+ 55us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:05.233002 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:05.233077 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:05.237458 (+ 4381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:05.238681 (+ 1223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:05.238692 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:05.238695 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:05.238992 (+ 297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:05.239571 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:05.239576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:05.239578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:05.240111 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:05.240670 (+ 559us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:05.241073 (+ 403us) server_negotiation.cc:299] Negotiation successful
0924 12:56:05.241411 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":440,"threads_started":1}
I20260924 12:56:05.243640 24297 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:05.339918 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 24174
I20260924 12:56:05.357096 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 23780
I20260924 12:56:05.358892 23842 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:05.472012 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 23780
I20260924 12:56:05.498376 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:43915
--webserver_interface=127.11.49.126
--webserver_port=40515
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:43915
--ranger_config_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:38431/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.49.84:38431/kms with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:05.961450 24314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:05.961891 24314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:05.962085 24314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:05.971331 24314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:56:05.971545 24314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:05.971657 24314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:05.971753 24314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:56:05.971837 24314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:56:05.984642 24314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.49.84:38431/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:43915
--ranger_config_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:43915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=40515
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:05.986588 24314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:05.988639 24314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:06.005656 24322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:06.005826 24319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:06.006047 24320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:06.007459 24314 server_base.cc:1034] running on GCE node
I20260924 12:56:06.008718 24314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:06.011025 24314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:06.012452 24314 hybrid_clock.cc:648] HybridClock initialized: now 1790254566012392 us; error 88 us; skew 500 ppm
I20260924 12:56:06.013064 24314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:06 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254566, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:06.017632 24314 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:56:06.019615 24314 webserver.cc:460] Webserver started at http://127.11.49.126:40515/ using document root <none> and password file <none>
I20260924 12:56:06.020438 24314 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:06.020572 24314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 24 12:56:06 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254566, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:56:06.081696 24314 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.001s
I20260924 12:56:06.085848 24330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:06.088229 24314 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260924 12:56:06.088587 24314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "921c628c2f9e402daaea90376cac88a8"
format_stamp: "Formatted at 2026-09-24 12:56:00 on dist-test-slave-m9hg"
server_key: "575d396e179f4f9034dcc5cce9ad43e9"
server_key_iv: "2e766ee33971be4e3f877f3faf4223fb"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:06.089862 24314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:06.108242 24314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:06.113328 24314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:06.113596 24314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:06.137282 24314 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:43915
I20260924 12:56:06.137454 24381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:43915 every 8 connection(s)
I20260924 12:56:06.139096 24314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:56:06.141820 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 24314
I20260924 12:56:06.143137 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:38431/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:45491
--local_ip_for_outbound_sockets=127.11.49.65
--tserver_master_addrs=127.11.49.126:43915
--webserver_port=42449
--webserver_interface=127.11.49.65
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.49.84:38431/kms with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:56:06.152017 24382 sys_catalog.cc:263] Verifying existing consensus state
I20260924 12:56:06.157483 24382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8: Bootstrap starting.
I20260924 12:56:06.182273 24382 log.cc:824] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:06.195866 24382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 12:56:06.196756 24382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8: Bootstrap complete.
I20260924 12:56:06.208004 24382 raft_consensus.cc:348] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } }
I20260924 12:56:06.209308 24382 raft_consensus.cc:729] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 921c628c2f9e402daaea90376cac88a8, State: Initialized, Role: FOLLOWER
I20260924 12:56:06.210574 24382 consensus_queue.cc:260] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } }
I20260924 12:56:06.210981 24382 raft_consensus.cc:388] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:56:06.211169 24382 raft_consensus.cc:482] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:56:06.211378 24382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 1 FOLLOWER]: Advancing to term 2
I20260924 12:56:06.217406 24382 raft_consensus.cc:504] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } }
I20260924 12:56:06.218211 24382 leader_election.cc:302] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 921c628c2f9e402daaea90376cac88a8; no voters:
I20260924 12:56:06.219103 24382 leader_election.cc:288] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260924 12:56:06.219329 24386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260924 12:56:06.220798 24386 raft_consensus.cc:686] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [term 2 LEADER]: Becoming Leader. State: Replica: 921c628c2f9e402daaea90376cac88a8, State: Running, Role: LEADER
I20260924 12:56:06.221709 24386 consensus_queue.cc:237] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } }
I20260924 12:56:06.222218 24382 sys_catalog.cc:564] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:56:06.225162 24388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 921c628c2f9e402daaea90376cac88a8. Latest consensus state: current_term: 2 leader_uuid: "921c628c2f9e402daaea90376cac88a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } } }
I20260924 12:56:06.226293 24388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:06.226125 24387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "921c628c2f9e402daaea90376cac88a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921c628c2f9e402daaea90376cac88a8" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 43915 } } }
I20260924 12:56:06.226714 24387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8 [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:06.228005 24392 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:56:06.247336 24392 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:56:06.249461 24392 catalog_manager.cc:1259] Loaded cluster ID: a31bf466676a4a28b6caedc2ffda5525
I20260924 12:56:06.249755 24392 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:56:06.254840 24392 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:56:06.257604 24392 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8: Loaded TSK: 0
I20260924 12:56:06.260120 24392 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:56:06.267189 24382 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260924 12:56:06.711236 24384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:06.711905 24384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:06.712162 24384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:06.726593 24384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:06.726927 24384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:06.727210 24384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:56:06.746661 24384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.49.84:38431/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:45491
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=42449
--tserver_master_addrs=127.11.49.126:43915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:06.749330 24384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:06.751982 24384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:06.781811 24419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:06.782470 24420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:06.790865 24422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:06.790817 24384 server_base.cc:1034] running on GCE node
I20260924 12:56:06.791947 24384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:06.793762 24384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:06.795356 24384 hybrid_clock.cc:648] HybridClock initialized: now 1790254566795226 us; error 104 us; skew 500 ppm
I20260924 12:56:06.795864 24384 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:06 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254566, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:06.800523 24384 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:56:06.809396 24384 webserver.cc:460] Webserver started at http://127.11.49.65:42449/ using document root <none> and password file <none>
I20260924 12:56:06.810354 24384 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:06.810545 24384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 24 12:56:06 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254566, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:56:06.833596 24384 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260924 12:56:06.837136 24430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:06.838763 24384 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260924 12:56:06.838933 24384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "2351acab904b4a9db8d2c9f8f52e851e"
format_stamp: "Formatted at 2026-09-24 12:56:02 on dist-test-slave-m9hg"
server_key: "89a392af6617195891a6d4d076f26832"
server_key_iv: "9f52f86e305396585fdfcef3d91801d1"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:06.840142 24384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:06.874176 24384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:06.878814 24384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:06.879206 24384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:06.881536 24384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:06.889885 24384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:06.890111 24384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260924 12:56:06.890317 24384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:06.890790 24384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:06.982137 24384 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:45491
I20260924 12:56:06.982283 24543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:45491 every 8 connection(s)
I20260924 12:56:06.984588 24384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:56:06.993464 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 24384
I20260924 12:56:06.994896 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:38431/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:38223
--local_ip_for_outbound_sockets=127.11.49.66
--tserver_master_addrs=127.11.49.126:43915
--webserver_port=43933
--webserver_interface=127.11.49.66
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.49.84:38431/kms with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:56:07 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254566, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:07.034862 24546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:06.992519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:43915 (local address 127.11.49.65:57925)
0924 12:56:06.997259 (+ 4740us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:06.997346 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:07.000667 (+ 3321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:07.004546 (+ 3879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:07.004560 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:07.005169 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:07.005806 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:07.005828 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:07.008778 (+ 2950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:07.008796 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:07.011413 (+ 2617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:07.011439 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:07.013898 (+ 2459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:07.013910 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:07.014264 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:07.015640 (+ 1376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:07.015681 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:07.019279 (+ 3598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:07.027148 (+ 7869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:07.027165 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:07.027190 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:07.028087 (+ 897us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:07.028980 (+ 893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:07.028989 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:07.028994 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:07.029302 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:07.030617 (+ 1315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:07.030628 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:07.031088 (+ 460us) client_negotiation.cc:769] Sending connection context
0924 12:56:07.031409 (+ 321us) client_negotiation.cc:240] Negotiation successful
0924 12:56:07.032079 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4264,"thread_start_us":3927,"threads_started":1}
I20260924 12:56:07.038043 24547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:06.992859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:57925 (local address 127.11.49.126:43915)
0924 12:56:07.002264 (+ 9405us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:07.002288 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:07.002348 (+ 60us) server_negotiation.cc:407] Connection header received
0924 12:56:07.002892 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:07.002916 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:07.003510 (+ 594us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:07.004057 (+ 547us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:07.006079 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:07.008476 (+ 2397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:07.011681 (+ 3205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:07.013123 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:07.013384 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:07.019763 (+ 6379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:07.019779 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:07.019808 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:07.019885 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:07.026786 (+ 6901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:07.028424 (+ 1638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:07.028440 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:07.028450 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:07.028773 (+ 323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:07.029550 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:07.029559 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:07.029566 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:07.030418 (+ 852us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:07.034530 (+ 4112us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:07.035881 (+ 1351us) server_negotiation.cc:299] Negotiation successful
0924 12:56:07.036463 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8618,"spinlock_wait_cycles":754048,"thread_start_us":8429,"threads_started":1}
I20260924 12:56:07.043933 24544 heartbeater.cc:347] Connected to a master server at 127.11.49.126:43915
I20260924 12:56:07.044562 24544 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:07.045928 24544 heartbeater.cc:511] Master 127.11.49.126:43915 requested a full tablet report, sending...
W20260924 12:56:07.051107 24544 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:43915 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260924 12:56:07.051493 24544 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:07.051936 24544 heartbeater.cc:511] Master 127.11.49.126:43915 requested a full tablet report, sending...
I20260924 12:56:07.053951 24544 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:07.054352 24544 heartbeater.cc:511] Master 127.11.49.126:43915 requested a full tablet report, sending...
W20260924 12:56:07.056260 24544 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260924 12:56:07.440091 24548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:07.440554 24548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:07.440776 24548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:07.449609 24548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:07.449792 24548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:07.449993 24548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:56:07.463624 24548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.49.84:38431/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:38223
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=43933
--tserver_master_addrs=127.11.49.126:43915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:07.465350 24548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:07.467141 24548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:07.491242 24561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:07.492071 24563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:07.492654 24560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:07.493650 24548 server_base.cc:1034] running on GCE node
I20260924 12:56:07.494707 24548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:07.496356 24548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:07.497674 24548 hybrid_clock.cc:648] HybridClock initialized: now 1790254567497606 us; error 66 us; skew 500 ppm
I20260924 12:56:07.498194 24548 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:07 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:07.503430 24548 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:56:07.508428 24548 webserver.cc:460] Webserver started at http://127.11.49.66:43933/ using document root <none> and password file <none>
I20260924 12:56:07.509730 24548 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:07.509961 24548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 24 12:56:07 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:56:07.539939 24548 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.001s
I20260924 12:56:07.545045 24571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:07.547510 24548 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260924 12:56:07.547851 24548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "abca6dd5ad454915a1b7417681700c3c"
format_stamp: "Formatted at 2026-09-24 12:56:03 on dist-test-slave-m9hg"
server_key: "08fab57a757f1a403162c7a8bd56966a"
server_key_iv: "045732e3b09abe3b5bb832a1d28a343f"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:07.549528 24548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:07.568138 24548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:07.573040 24548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:07.573441 24548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:07.575307 24548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:07.577292 24548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:07.577404 24548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:07.577523 24548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:07.577605 24548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:07.657189 24548 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:38223
I20260924 12:56:07.657235 24685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:38223 every 8 connection(s)
I20260924 12:56:07.659215 24548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:56:07.664952 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 24548
I20260924 12:56:07.666043 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.49.84:38431/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:39171
--local_ip_for_outbound_sockets=127.11.49.67
--tserver_master_addrs=127.11.49.126:43915
--webserver_port=45269
--webserver_interface=127.11.49.67
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.49.84:38431/kms with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:56:07 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:07.715144 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:07.663048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:35075 (local address 127.11.49.126:43915)
0924 12:56:07.663886 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:07.663892 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:07.665382 (+ 1490us) server_negotiation.cc:407] Connection header received
0924 12:56:07.670320 (+ 4938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:07.670331 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:07.670481 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:07.670616 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:07.674273 (+ 3657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:07.675735 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:07.680344 (+ 4609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:07.681524 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:07.681670 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:07.694103 (+ 12433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:07.694115 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:07.694120 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:07.694188 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:07.699094 (+ 4906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:07.700961 (+ 1867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:07.700970 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:07.700975 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:07.701221 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:07.702156 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:07.702164 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:07.702168 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:07.702714 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:07.702933 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:07.714229 (+ 11296us) server_negotiation.cc:299] Negotiation successful
0924 12:56:07.714646 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":387,"threads_started":1}
I20260924 12:56:07.718994 24689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:07.663691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:43915 (local address 127.11.49.66:35075)
0924 12:56:07.665142 (+ 1451us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:07.665210 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:07.669658 (+ 4448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:07.671566 (+ 1908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:07.671602 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:07.672597 (+ 995us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:07.673878 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:07.673924 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:07.676098 (+ 2174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:07.676107 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:07.679819 (+ 3712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:07.679869 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:07.682183 (+ 2314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:07.682189 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:07.682517 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:07.684717 (+ 2200us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:07.684766 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:07.693562 (+ 8796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:07.699555 (+ 5993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:07.699569 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:07.699598 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:07.700713 (+ 1115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:07.701480 (+ 767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:07.701485 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:07.701489 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:07.701847 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:07.703076 (+ 1229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:07.703087 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:07.703770 (+ 683us) client_negotiation.cc:769] Sending connection context
0924 12:56:07.715593 (+ 11823us) client_negotiation.cc:240] Negotiation successful
0924 12:56:07.716679 (+ 1086us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1077,"thread_start_us":528,"threads_started":1}
I20260924 12:56:07.722301 24686 heartbeater.cc:347] Connected to a master server at 127.11.49.126:43915
I20260924 12:56:07.722996 24686 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:07.724867 24686 heartbeater.cc:511] Master 127.11.49.126:43915 requested a full tablet report, sending...
I20260924 12:56:07.728965 24347 ts_manager.cc:194] Registered new tserver with Master: abca6dd5ad454915a1b7417681700c3c (127.11.49.66:38223)
I20260924 12:56:07.731739 24347 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:35075
Sep 24 12:56:07 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790254567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:08.056488 24544 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:08.057168 24544 heartbeater.cc:511] Master 127.11.49.126:43915 requested a full tablet report, sending...
I20260924 12:56:08.058883 24347 ts_manager.cc:194] Registered new tserver with Master: 2351acab904b4a9db8d2c9f8f52e851e (127.11.49.65:45491)
I20260924 12:56:08.060206 24347 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:57925
W20260924 12:56:08.239140 24690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:08.239563 24690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:08.239758 24690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:08.249065 24690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:08.249197 24690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:08.249383 24690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:56:08.263137 24690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.49.84:38431/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:39171
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=45269
--tserver_master_addrs=127.11.49.126:43915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:08.264854 24690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:08.266285 24690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:08.288550 24698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:08.294365 24699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:08.297044 24701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:08.297401 24690 server_base.cc:1034] running on GCE node
I20260924 12:56:08.298198 24690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:08.299433 24690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:08.300765 24690 hybrid_clock.cc:648] HybridClock initialized: now 1790254568300667 us; error 92 us; skew 500 ppm
I20260924 12:56:08.301185 24690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:08 dist-test-slave-m9hg krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254568, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:08.314648 24690 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:56:08.316962 24690 webserver.cc:460] Webserver started at http://127.11.49.67:45269/ using document root <none> and password file <none>
I20260924 12:56:08.317826 24690 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:08.318012 24690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 24 12:56:08 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254568, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:56:08.353025 24690 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.006s sys 0.004s
I20260924 12:56:08.357949 24709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:08.360351 24690 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260924 12:56:08.360586 24690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "4440047715ec49bba93ee3f5433d082a"
format_stamp: "Formatted at 2026-09-24 12:56:04 on dist-test-slave-m9hg"
server_key: "5c249113e7c8f7f03c9d3cbdd973e61b"
server_key_iv: "9c4eabe27f91c58da3298a00937f9061"
server_key_version: "kuduclusterkey@0"
I20260924 12:56:08.362176 24690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Sep 24 12:56:08 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:56:08.385583 24690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:08.391865 24690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:08.392208 24690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:08.394618 24690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:08.397115 24690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:08.397269 24690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:08.397379 24690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:08.397464 24690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:08.543085 24690 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:39171
I20260924 12:56:08.543197 24821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:39171 every 8 connection(s)
I20260924 12:56:08.545763 24690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:56:08.550166 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 24690
I20260924 12:56:08.637017 24826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:08.553013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45634 (local address 127.11.49.126:43915)
0924 12:56:08.596398 (+ 43385us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:08.596404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:08.600409 (+ 4005us) server_negotiation.cc:407] Connection header received
0924 12:56:08.600499 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:08.600505 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:08.600614 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:08.600764 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:08.603390 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.604663 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.609618 (+ 4955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.610330 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.610485 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:08.624666 (+ 14181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:08.624675 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:08.624681 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:08.624746 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:08.629191 (+ 4445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:08.630477 (+ 1286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:08.630485 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:08.630490 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:08.630705 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:08.634040 (+ 3335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:08.634056 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:08.634060 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:08.634489 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:08.634788 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:08.636258 (+ 1470us) server_negotiation.cc:299] Negotiation successful
0924 12:56:08.636575 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43276,"thread_start_us":44469,"threads_started":1}
Sep 24 12:56:08 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254568, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:08.656206 24825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:08.552476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:35903 (local address 127.11.49.126:43915)
0924 12:56:08.596004 (+ 43528us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:08.596012 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:08.600920 (+ 4908us) server_negotiation.cc:407] Connection header received
0924 12:56:08.610815 (+ 9895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:08.610821 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:08.610912 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:08.610990 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:08.619368 (+ 8378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.620869 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.630998 (+ 10129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.631770 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.631886 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:08.644991 (+ 13105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:08.645000 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:08.645005 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:08.645054 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:08.649117 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:08.650368 (+ 1251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:08.650374 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:08.650377 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:08.650553 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:08.653692 (+ 3139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:08.653699 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:08.653703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:08.654124 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:08.654283 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:08.655418 (+ 1135us) server_negotiation.cc:299] Negotiation successful
0924 12:56:08.655765 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43348,"thread_start_us":45054,"threads_started":1}
I20260924 12:56:08.670150 24824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:08.551073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:43915 (local address 127.11.49.67:35903)
0924 12:56:08.598578 (+ 47505us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:08.598676 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:08.606077 (+ 7401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:08.612679 (+ 6602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:08.612694 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:08.613485 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:08.614430 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:08.614469 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.621227 (+ 6758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.621234 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:08.624028 (+ 2794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:08.624065 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.632416 (+ 8351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.632426 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:08.632837 (+ 411us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:08.641263 (+ 8426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:08.641304 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:08.644588 (+ 3284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:08.649391 (+ 4803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:08.649403 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:08.649426 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:08.650194 (+ 768us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:08.653199 (+ 3005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:08.653204 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:08.653208 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:08.653534 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:08.654397 (+ 863us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:08.654407 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:08.654934 (+ 527us) client_negotiation.cc:769] Sending connection context
0924 12:56:08.667727 (+ 12793us) client_negotiation.cc:240] Negotiation successful
0924 12:56:08.668521 (+ 794us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47071,"thread_start_us":55226,"threads_started":1}
I20260924 12:56:08.672433 24822 heartbeater.cc:347] Connected to a master server at 127.11.49.126:43915
I20260924 12:56:08.672860 24822 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:08.673821 24822 heartbeater.cc:511] Master 127.11.49.126:43915 requested a full tablet report, sending...
I20260924 12:56:08.675804 24347 ts_manager.cc:194] Registered new tserver with Master: 4440047715ec49bba93ee3f5433d082a (127.11.49.67:39171)
I20260924 12:56:08.677040 24347 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:35903
I20260924 12:56:08.681098 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:56:08.738554 24686 heartbeater.cc:503] Master 127.11.49.126:43915 was elected leader, sending a full tablet report...
I20260924 12:56:08.743698 24825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:08.714424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45638 (local address 127.11.49.126:43915)
0924 12:56:08.714624 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:08.714631 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:08.722164 (+ 7533us) server_negotiation.cc:407] Connection header received
0924 12:56:08.722737 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:08.722744 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:08.722855 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:08.722936 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:08.725482 (+ 2546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.726742 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.729361 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.730022 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.730151 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:08.734371 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:08.734379 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:08.734384 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:08.734459 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:08.738398 (+ 3939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:08.739664 (+ 1266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:08.739670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:08.739673 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:08.739894 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:08.741500 (+ 1606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:08.741506 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:08.741510 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:08.741900 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:08.742129 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:08.742743 (+ 614us) server_negotiation.cc:299] Negotiation successful
0924 12:56:08.743265 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260924 12:56:08.752167 24347 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45638:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:56:08.765576 24347 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:56:08.862037 24839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:08.835322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54814 (local address 127.11.49.66:38223)
0924 12:56:08.838737 (+ 3415us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:08.838749 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:08.846930 (+ 8181us) server_negotiation.cc:407] Connection header received
0924 12:56:08.850289 (+ 3359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:08.850302 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:08.850539 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:08.850712 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:08.851811 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.853377 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.857661 (+ 4284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.859606 (+ 1945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.859791 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:08.860145 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:08.861221 (+ 1076us) server_negotiation.cc:299] Negotiation successful
0924 12:56:08.861546 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3160,"thread_start_us":2959,"threads_started":1}
I20260924 12:56:08.863173 24837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:08.834449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:38223 (local address 127.0.0.1:54814)
0924 12:56:08.846652 (+ 12203us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:08.846758 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:08.850043 (+ 3285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:08.851029 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:08.851033 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:08.851060 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:08.851511 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:08.851525 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.853544 (+ 2019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.853550 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:08.857311 (+ 3761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:08.857343 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.860516 (+ 3173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.860527 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:08.860819 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:08.860901 (+ 82us) client_negotiation.cc:769] Sending connection context
0924 12:56:08.862370 (+ 1469us) client_negotiation.cc:240] Negotiation successful
0924 12:56:08.862717 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11786,"thread_start_us":17818,"threads_started":1}
I20260924 12:56:08.865130 24840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:08.835478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56320 (local address 127.11.49.65:45491)
0924 12:56:08.841074 (+ 5596us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:08.841089 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:08.847640 (+ 6551us) server_negotiation.cc:407] Connection header received
0924 12:56:08.848209 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:08.848223 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:08.850165 (+ 1942us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:08.850398 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:08.851525 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.853263 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.860008 (+ 6745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.863386 (+ 3378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.863515 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:08.863780 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:08.864537 (+ 757us) server_negotiation.cc:299] Negotiation successful
0924 12:56:08.864738 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3644,"thread_start_us":3448,"threads_started":1}
I20260924 12:56:08.865962 24838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:08.834562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45491 (local address 127.0.0.1:56320)
0924 12:56:08.847501 (+ 12939us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:08.847524 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:08.847864 (+ 340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:08.850733 (+ 2869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:08.850740 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:08.850773 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:08.851257 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:08.851276 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.853507 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.853515 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:08.859749 (+ 6234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:08.859772 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.864030 (+ 4258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.864038 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:08.864255 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:08.864332 (+ 77us) client_negotiation.cc:769] Sending connection context
0924 12:56:08.865409 (+ 1077us) client_negotiation.cc:240] Negotiation successful
0924 12:56:08.865590 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12771,"thread_start_us":12645,"threads_started":1}
I20260924 12:56:08.867141 24841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:08.838428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:39171 (local address 127.0.0.1:42932)
0924 12:56:08.848983 (+ 10555us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:08.849015 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:08.849250 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:08.851451 (+ 2201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:08.851463 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:08.851506 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:08.852017 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:08.852034 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.854320 (+ 2286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.854327 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:08.857565 (+ 3238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:08.857590 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.866360 (+ 8770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.866367 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:08.866563 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:08.866599 (+ 36us) client_negotiation.cc:769] Sending connection context
0924 12:56:08.866693 (+ 94us) client_negotiation.cc:240] Negotiation successful
0924 12:56:08.866833 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10359,"thread_start_us":10109,"threads_started":1}
I20260924 12:56:08.870710 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:08.839123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42932 (local address 127.11.49.67:39171)
0924 12:56:08.850098 (+ 10975us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:08.850111 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:08.850156 (+ 45us) server_negotiation.cc:407] Connection header received
0924 12:56:08.850306 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:08.850316 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:08.850663 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:08.850992 (+ 329us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:08.852334 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.854055 (+ 1721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.863647 (+ 9592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:08.865820 (+ 2173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:08.866038 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:08.869807 (+ 3769us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:08.869917 (+ 110us) server_negotiation.cc:299] Negotiation successful
0924 12:56:08.870127 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10729,"thread_start_us":10478,"threads_started":1}
I20260924 12:56:08.871711 24621 tablet_service.cc:1467] Processing CreateTablet for tablet 08eee0e8f0b7463facff5ee7adb27f1d (DEFAULT_TABLE table=test-table [id=c32dbc57b9184b44b13b43a8d9c56e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:08.873656 24621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08eee0e8f0b7463facff5ee7adb27f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:08.876216 24757 tablet_service.cc:1467] Processing CreateTablet for tablet 08eee0e8f0b7463facff5ee7adb27f1d (DEFAULT_TABLE table=test-table [id=c32dbc57b9184b44b13b43a8d9c56e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:08.878031 24757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08eee0e8f0b7463facff5ee7adb27f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:08.871685 24478 tablet_service.cc:1467] Processing CreateTablet for tablet 08eee0e8f0b7463facff5ee7adb27f1d (DEFAULT_TABLE table=test-table [id=c32dbc57b9184b44b13b43a8d9c56e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:08.880968 24478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08eee0e8f0b7463facff5ee7adb27f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:08.904893 24844 tablet_bootstrap.cc:492] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: Bootstrap starting.
I20260924 12:56:08.906149 24845 tablet_bootstrap.cc:492] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: Bootstrap starting.
I20260924 12:56:08.909452 24844 tablet_bootstrap.cc:654] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:08.909653 24845 tablet_bootstrap.cc:654] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:08.911057 24845 log.cc:824] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:08.911057 24844 log.cc:824] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:08.915505 24846 tablet_bootstrap.cc:492] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: Bootstrap starting.
I20260924 12:56:08.918792 24844 tablet_bootstrap.cc:492] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: No bootstrap required, opened a new log
I20260924 12:56:08.919299 24844 ts_tablet_manager.cc:1397] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20260924 12:56:08.922494 24846 tablet_bootstrap.cc:654] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:08.924870 24846 log.cc:824] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:08.927583 24845 tablet_bootstrap.cc:492] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: No bootstrap required, opened a new log
I20260924 12:56:08.928020 24845 ts_tablet_manager.cc:1397] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.010s
I20260924 12:56:08.934796 24844 raft_consensus.cc:348] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abca6dd5ad454915a1b7417681700c3c" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38223 } } peers { permanent_uuid: "2351acab904b4a9db8d2c9f8f52e851e" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45491 } } peers { permanent_uuid: "4440047715ec49bba93ee3f5433d082a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 39171 } }
I20260924 12:56:08.935353 24844 raft_consensus.cc:374] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:08.935470 24844 raft_consensus.cc:729] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abca6dd5ad454915a1b7417681700c3c, State: Initialized, Role: FOLLOWER
I20260924 12:56:08.936864 24844 consensus_queue.cc:260] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abca6dd5ad454915a1b7417681700c3c" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38223 } } peers { permanent_uuid: "2351acab904b4a9db8d2c9f8f52e851e" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45491 } } peers { permanent_uuid: "4440047715ec49bba93ee3f5433d082a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 39171 } }
I20260924 12:56:08.939429 24844 ts_tablet_manager.cc:1428] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: Time spent starting tablet: real 0.020s user 0.018s sys 0.000s
I20260924 12:56:08.941102 24845 raft_consensus.cc:348] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abca6dd5ad454915a1b7417681700c3c" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38223 } } peers { permanent_uuid: "2351acab904b4a9db8d2c9f8f52e851e" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45491 } } peers { permanent_uuid: "4440047715ec49bba93ee3f5433d082a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 39171 } }
I20260924 12:56:08.941810 24845 raft_consensus.cc:374] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:08.941977 24845 raft_consensus.cc:729] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4440047715ec49bba93ee3f5433d082a, State: Initialized, Role: FOLLOWER
I20260924 12:56:08.943082 24845 consensus_queue.cc:260] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abca6dd5ad454915a1b7417681700c3c" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38223 } } peers { permanent_uuid: "2351acab904b4a9db8d2c9f8f52e851e" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45491 } } peers { permanent_uuid: "4440047715ec49bba93ee3f5433d082a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 39171 } }
I20260924 12:56:08.945231 24846 tablet_bootstrap.cc:492] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: No bootstrap required, opened a new log
I20260924 12:56:08.947670 24846 ts_tablet_manager.cc:1397] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.009s
I20260924 12:56:08.952750 24845 ts_tablet_manager.cc:1428] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: Time spent starting tablet: real 0.025s user 0.015s sys 0.011s
Sep 24 12:56:08 dist-test-slave-m9hg krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for HTTP/127.11.49.84@KRBTEST.COM
I20260924 12:56:08.953401 24822 heartbeater.cc:503] Master 127.11.49.126:43915 was elected leader, sending a full tablet report...
I20260924 12:56:08.960913 24846 raft_consensus.cc:348] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abca6dd5ad454915a1b7417681700c3c" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38223 } } peers { permanent_uuid: "2351acab904b4a9db8d2c9f8f52e851e" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45491 } } peers { permanent_uuid: "4440047715ec49bba93ee3f5433d082a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 39171 } }
I20260924 12:56:08.961483 24846 raft_consensus.cc:374] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:08.961592 24846 raft_consensus.cc:729] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2351acab904b4a9db8d2c9f8f52e851e, State: Initialized, Role: FOLLOWER
I20260924 12:56:08.962329 24846 consensus_queue.cc:260] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abca6dd5ad454915a1b7417681700c3c" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38223 } } peers { permanent_uuid: "2351acab904b4a9db8d2c9f8f52e851e" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45491 } } peers { permanent_uuid: "4440047715ec49bba93ee3f5433d082a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 39171 } }
I20260924 12:56:08.964792 24544 heartbeater.cc:503] Master 127.11.49.126:43915 was elected leader, sending a full tablet report...
I20260924 12:56:08.965499 24846 ts_tablet_manager.cc:1428] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: Time spent starting tablet: real 0.018s user 0.013s sys 0.003s
W20260924 12:56:08.991756 24545 tablet.cc:2369] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:56:09.112877 24823 tablet.cc:2369] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:56:09.162978 24687 tablet.cc:2369] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:56:09.207185 24850 raft_consensus.cc:482] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:56:09.207536 24850 raft_consensus.cc:504] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abca6dd5ad454915a1b7417681700c3c" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38223 } } peers { permanent_uuid: "2351acab904b4a9db8d2c9f8f52e851e" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45491 } } peers { permanent_uuid: "4440047715ec49bba93ee3f5433d082a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 39171 } }
I20260924 12:56:09.210034 24850 leader_election.cc:288] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2351acab904b4a9db8d2c9f8f52e851e (127.11.49.65:45491), 4440047715ec49bba93ee3f5433d082a (127.11.49.67:39171)
I20260924 12:56:09.227778 24855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:09.211689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:39171 (local address 127.11.49.66:40545)
0924 12:56:09.218994 (+ 7305us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:09.219019 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:09.219261 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:09.219949 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:09.219954 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:09.219983 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:09.220735 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:09.220752 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.222280 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.222286 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:09.224851 (+ 2565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:09.224871 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.226859 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.226866 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:09.227041 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:09.227078 (+ 37us) client_negotiation.cc:769] Sending connection context
0924 12:56:09.227170 (+ 92us) client_negotiation.cc:240] Negotiation successful
0924 12:56:09.227321 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7124,"mutex_wait_us":2,"spinlock_wait_cycles":44544,"thread_start_us":6428,"threads_started":1}
I20260924 12:56:09.228653 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:09.211646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:40545 (local address 127.11.49.67:39171)
0924 12:56:09.211872 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:09.211879 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:09.219413 (+ 7534us) server_negotiation.cc:407] Connection header received
0924 12:56:09.219509 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:09.219514 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:09.219598 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:09.219710 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:09.220968 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.222094 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.225112 (+ 3018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.226421 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.226600 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:09.226679 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:09.228221 (+ 1542us) server_negotiation.cc:299] Negotiation successful
0924 12:56:09.228404 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260924 12:56:09.229387 24840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:09.211121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:33971 (local address 127.11.49.65:45491)
0924 12:56:09.211482 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:09.211491 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:09.219115 (+ 7624us) server_negotiation.cc:407] Connection header received
0924 12:56:09.219460 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:09.219469 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:09.219572 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:09.219689 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:09.220972 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.222694 (+ 1722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.226167 (+ 3473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.227692 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.227888 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:09.227985 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:09.228816 (+ 831us) server_negotiation.cc:299] Negotiation successful
0924 12:56:09.229032 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260924 12:56:09.230537 24854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:09.210755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45491 (local address 127.11.49.66:33971)
0924 12:56:09.218891 (+ 8136us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:09.218924 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:09.219253 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:09.219916 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:09.219922 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:09.219956 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:09.220723 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:09.220741 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.223176 (+ 2435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.223187 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:09.225865 (+ 2678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:09.225892 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.228264 (+ 2372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.228301 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:09.228544 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:09.228591 (+ 47us) client_negotiation.cc:769] Sending connection context
0924 12:56:09.229772 (+ 1181us) client_negotiation.cc:240] Negotiation successful
0924 12:56:09.229990 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7903,"mutex_wait_us":2,"spinlock_wait_cycles":47232,"thread_start_us":6645,"threads_started":1}
I20260924 12:56:09.230477 24777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08eee0e8f0b7463facff5ee7adb27f1d" candidate_uuid: "abca6dd5ad454915a1b7417681700c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4440047715ec49bba93ee3f5433d082a" is_pre_election: true
I20260924 12:56:09.231087 24777 raft_consensus.cc:2454] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abca6dd5ad454915a1b7417681700c3c in term 0.
I20260924 12:56:09.232456 24498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08eee0e8f0b7463facff5ee7adb27f1d" candidate_uuid: "abca6dd5ad454915a1b7417681700c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351acab904b4a9db8d2c9f8f52e851e" is_pre_election: true
I20260924 12:56:09.233160 24498 raft_consensus.cc:2454] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abca6dd5ad454915a1b7417681700c3c in term 0.
I20260924 12:56:09.234019 24572 leader_election.cc:302] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4440047715ec49bba93ee3f5433d082a, abca6dd5ad454915a1b7417681700c3c; no voters:
I20260924 12:56:09.234935 24850 raft_consensus.cc:2781] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:56:09.235425 24850 raft_consensus.cc:482] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:56:09.235589 24850 raft_consensus.cc:3037] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:09.239027 24850 raft_consensus.cc:504] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abca6dd5ad454915a1b7417681700c3c" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38223 } } peers { permanent_uuid: "2351acab904b4a9db8d2c9f8f52e851e" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45491 } } peers { permanent_uuid: "4440047715ec49bba93ee3f5433d082a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 39171 } }
I20260924 12:56:09.240725 24777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08eee0e8f0b7463facff5ee7adb27f1d" candidate_uuid: "abca6dd5ad454915a1b7417681700c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4440047715ec49bba93ee3f5433d082a"
I20260924 12:56:09.241001 24777 raft_consensus.cc:3037] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:09.241308 24498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08eee0e8f0b7463facff5ee7adb27f1d" candidate_uuid: "abca6dd5ad454915a1b7417681700c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2351acab904b4a9db8d2c9f8f52e851e"
I20260924 12:56:09.241700 24850 leader_election.cc:288] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [CANDIDATE]: Term 1 election: Requested vote from peers 2351acab904b4a9db8d2c9f8f52e851e (127.11.49.65:45491), 4440047715ec49bba93ee3f5433d082a (127.11.49.67:39171)
I20260924 12:56:09.241688 24498 raft_consensus.cc:3037] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:09.244566 24777 raft_consensus.cc:2454] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abca6dd5ad454915a1b7417681700c3c in term 1.
I20260924 12:56:09.245245 24572 leader_election.cc:302] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4440047715ec49bba93ee3f5433d082a, abca6dd5ad454915a1b7417681700c3c; no voters:
I20260924 12:56:09.245468 24498 raft_consensus.cc:2454] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abca6dd5ad454915a1b7417681700c3c in term 1.
I20260924 12:56:09.245689 24850 raft_consensus.cc:2781] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:56:09.248730 24850 raft_consensus.cc:686] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 1 LEADER]: Becoming Leader. State: Replica: abca6dd5ad454915a1b7417681700c3c, State: Running, Role: LEADER
I20260924 12:56:09.249404 24850 consensus_queue.cc:237] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abca6dd5ad454915a1b7417681700c3c" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38223 } } peers { permanent_uuid: "2351acab904b4a9db8d2c9f8f52e851e" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45491 } } peers { permanent_uuid: "4440047715ec49bba93ee3f5433d082a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 39171 } }
I20260924 12:56:09.256565 24346 catalog_manager.cc:5495] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c reported cstate change: term changed from 0 to 1, leader changed from <none> to abca6dd5ad454915a1b7417681700c3c (127.11.49.66). New cstate: current_term: 1 leader_uuid: "abca6dd5ad454915a1b7417681700c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abca6dd5ad454915a1b7417681700c3c" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2351acab904b4a9db8d2c9f8f52e851e" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4440047715ec49bba93ee3f5433d082a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 39171 } health_report { overall_health: UNKNOWN } } }
I20260924 12:56:09.325562 24839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:09.317184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54816 (local address 127.11.49.66:38223)
0924 12:56:09.317431 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:09.317438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:09.317797 (+ 359us) server_negotiation.cc:407] Connection header received
0924 12:56:09.318049 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:09.318055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:09.318172 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:09.318383 (+ 211us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:56:09.318948 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.320048 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.322316 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.323000 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.323150 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:09.323944 (+ 794us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:56:09.324734 (+ 790us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:56:09.324904 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:09.325144 (+ 240us) server_negotiation.cc:299] Negotiation successful
0924 12:56:09.325248 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260924 12:56:09.338033 24777 raft_consensus.cc:1261] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a [term 1 FOLLOWER]: Refusing update from remote peer abca6dd5ad454915a1b7417681700c3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:56:09.338025 24498 raft_consensus.cc:1261] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e [term 1 FOLLOWER]: Refusing update from remote peer abca6dd5ad454915a1b7417681700c3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:56:09.339623 24850 consensus_queue.cc:1035] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4440047715ec49bba93ee3f5433d082a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:56:09.340044 24862 consensus_queue.cc:1035] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2351acab904b4a9db8d2c9f8f52e851e" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:56:09.362254 24866 mvcc.cc:205] Tried to move back new op lower bound from 7332882715992993792 to 7332882715650596864. Current Snapshot: MvccSnapshot[applied={T|T < 7332882715992993792}]
I20260924 12:56:09.367486 24867 mvcc.cc:205] Tried to move back new op lower bound from 7332882715992993792 to 7332882715650596864. Current Snapshot: MvccSnapshot[applied={T|T < 7332882715992993792}]
I20260924 12:56:09.399946 24346 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:56:09.400418 24346 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:56:09.405596 24346 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 921c628c2f9e402daaea90376cac88a8: Sending DeleteTablet for 3 replicas of tablet 08eee0e8f0b7463facff5ee7adb27f1d
I20260924 12:56:09.407399 24478 tablet_service.cc:1514] Processing DeleteTablet for tablet 08eee0e8f0b7463facff5ee7adb27f1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:09 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:56320
I20260924 12:56:09.407842 24757 tablet_service.cc:1514] Processing DeleteTablet for tablet 08eee0e8f0b7463facff5ee7adb27f1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:09 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:42932
I20260924 12:56:09.408572 24621 tablet_service.cc:1514] Processing DeleteTablet for tablet 08eee0e8f0b7463facff5ee7adb27f1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:09 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:54814
I20260924 12:56:09.411928 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 24384
I20260924 12:56:09.420239 24879 tablet_replica.cc:330] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: stopping tablet replica
I20260924 12:56:09.421077 24879 raft_consensus.cc:2229] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:56:09.422158 24879 raft_consensus.cc:2258] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:09.426424 24877 tablet_replica.cc:330] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: stopping tablet replica
I20260924 12:56:09.427063 24877 raft_consensus.cc:2229] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:56:09.427605 24879 ts_tablet_manager.cc:1905] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:09.429085 24877 raft_consensus.cc:2258] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:09.432914 24878 tablet_replica.cc:330] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: stopping tablet replica
I20260924 12:56:09.433382 24878 raft_consensus.cc:2229] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:56:09.433902 24878 raft_consensus.cc:2258] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:09.435779 24877 ts_tablet_manager.cc:1905] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:09.436205 24878 ts_tablet_manager.cc:1905] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:09.443364 24878 ts_tablet_manager.cc:1918] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:09.443553 24878 log.cc:1196] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/08eee0e8f0b7463facff5ee7adb27f1d
I20260924 12:56:09.444126 24878 ts_tablet_manager.cc:1939] T 08eee0e8f0b7463facff5ee7adb27f1d P 4440047715ec49bba93ee3f5433d082a: Deleting consensus metadata
I20260924 12:56:09.448161 24879 ts_tablet_manager.cc:1918] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:09.448415 24879 log.cc:1196] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/08eee0e8f0b7463facff5ee7adb27f1d
I20260924 12:56:09.448983 24879 ts_tablet_manager.cc:1939] T 08eee0e8f0b7463facff5ee7adb27f1d P abca6dd5ad454915a1b7417681700c3c: Deleting consensus metadata
I20260924 12:56:09.451191 24333 catalog_manager.cc:4841] TS abca6dd5ad454915a1b7417681700c3c (127.11.49.66:38223): tablet 08eee0e8f0b7463facff5ee7adb27f1d (table test-table [id=c32dbc57b9184b44b13b43a8d9c56e64]) successfully deleted
I20260924 12:56:09.452521 24840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:09.413395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56336 (local address 127.11.49.65:45491)
0924 12:56:09.413678 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:09.413685 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:09.419998 (+ 6313us) server_negotiation.cc:407] Connection header received
0924 12:56:09.421475 (+ 1477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:09.421482 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:09.421617 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:09.421775 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:09.427336 (+ 5561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.428471 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.433645 (+ 5174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.434310 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.434435 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:09.443743 (+ 9308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:09.443760 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:09.443780 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:09.443839 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:09.448128 (+ 4289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:09.449494 (+ 1366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:09.449504 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:09.449507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:09.449792 (+ 285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:09.450306 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:09.450313 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:09.450316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:09.450804 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:09.451110 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:09.451852 (+ 742us) server_negotiation.cc:299] Negotiation successful
0924 12:56:09.452095 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260924 12:56:09.453480 24331 catalog_manager.cc:4841] TS 4440047715ec49bba93ee3f5433d082a (127.11.49.67:39171): tablet 08eee0e8f0b7463facff5ee7adb27f1d (table test-table [id=c32dbc57b9184b44b13b43a8d9c56e64]) successfully deleted
I20260924 12:56:09.456009 24877 ts_tablet_manager.cc:1918] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:09.456192 24877 log.cc:1196] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/08eee0e8f0b7463facff5ee7adb27f1d
I20260924 12:56:09.457108 24538 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:09.564181 24877 ts_tablet_manager.cc:1939] T 08eee0e8f0b7463facff5ee7adb27f1d P 2351acab904b4a9db8d2c9f8f52e851e: Deleting consensus metadata
I20260924 12:56:09.566213 24332 catalog_manager.cc:4841] TS 2351acab904b4a9db8d2c9f8f52e851e (127.11.49.65:45491): tablet 08eee0e8f0b7463facff5ee7adb27f1d (table test-table [id=c32dbc57b9184b44b13b43a8d9c56e64]) successfully deleted
I20260924 12:56:09.566340 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 24384
I20260924 12:56:09.590636 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 24548
I20260924 12:56:09.607856 24839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:09.591455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54826 (local address 127.11.49.66:38223)
0924 12:56:09.591648 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:09.591654 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:09.591771 (+ 117us) server_negotiation.cc:407] Connection header received
0924 12:56:09.591968 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:09.591974 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:09.592054 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:09.592179 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:09.593547 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.594783 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.596164 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.596918 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.597065 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:09.600851 (+ 3786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:09.600866 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:09.600881 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:09.600943 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:09.604220 (+ 3277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:09.605208 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:09.605218 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:09.605222 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:09.605399 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:09.605850 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:09.605856 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:09.605860 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:09.606404 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:09.606733 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:09.607018 (+ 285us) server_negotiation.cc:299] Negotiation successful
0924 12:56:09.607422 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260924 12:56:09.608775 24681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:09.746423 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 24548
I20260924 12:56:09.767904 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 24690
I20260924 12:56:09.786710 24883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:09.769278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42942 (local address 127.11.49.67:39171)
0924 12:56:09.769934 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:09.769941 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:09.769966 (+ 25us) server_negotiation.cc:407] Connection header received
0924 12:56:09.770043 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:09.770047 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:09.770144 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:09.770295 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:09.771909 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.773162 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.774785 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:09.775469 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:09.775634 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:09.778750 (+ 3116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:09.778774 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:09.778796 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:09.778867 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:09.782741 (+ 3874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:09.783878 (+ 1137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:09.783889 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:09.783892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:09.784112 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:09.784674 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:09.784681 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:09.784684 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:09.785295 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:09.785697 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:09.786008 (+ 311us) server_negotiation.cc:299] Negotiation successful
0924 12:56:09.786310 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":374,"threads_started":1}
I20260924 12:56:09.787711 24817 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:09.881824 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 24690
I20260924 12:56:09.902915 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 24314
I20260924 12:56:09.904237 24377 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:10.039642 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 24314
I20260924 12:56:10.068150 11461 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260924 12:56:10.415545 11461 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260924 12:56:10.415824 11461 mini_ranger.cc:66] Stopping Ranger...
I20260924 12:56:10.764256 11461 mini_ranger.cc:68] Stopped Ranger
2026-09-24 12:56:10.764 UTC [23366] LOG: received smart shutdown request
2026-09-24 12:56:10.769 UTC [23366] LOG: background worker "logical replication launcher" (PID 23375) exited with exit code 1
2026-09-24 12:56:10.769 UTC [23370] LOG: shutting down
2026-09-24 12:56:10.976 UTC [23366] LOG: database system is shut down
2026-09-24T12:56:10Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (67439 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:56:11 dist-test-slave-m9hg krb5kdc[24894](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:56:11 dist-test-slave-m9hg krb5kdc[24894](info): set up 2 sockets
Sep 24 12:56:11 dist-test-slave-m9hg krb5kdc[24894](info): commencing operation
krb5kdc: starting...
W20260924 12:56:12.277804 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.003s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:56:12 dist-test-slave-m9hg krb5kdc[24894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:56:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:56:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:56:12.566074 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:44001
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:44001,127.11.49.125:43045,127.11.49.124:43373
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:12.990902 24907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:12.991334 24907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:12.991530 24907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:13.000301 24907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:56:13.000483 24907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:13.000598 24907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:13.000705 24907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:56:13.000779 24907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:56:13.012763 24907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:44001,127.11.49.125:43045,127.11.49.124:43373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:44001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:13.014662 24907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:13.016904 24907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:13.033098 24912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:13.033046 24915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:13.033095 24913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:13.034543 24907 server_base.cc:1034] running on GCE node
I20260924 12:56:13.035542 24907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:13.037328 24907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:13.038590 24907 hybrid_clock.cc:648] HybridClock initialized: now 1790254573038537 us; error 65 us; skew 500 ppm
I20260924 12:56:13.039019 24907 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:13 dist-test-slave-m9hg krb5kdc[24894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254573, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:13.042855 24907 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:56:13.044873 24907 webserver.cc:460] Webserver started at http://127.11.49.126:33789/ using document root <none> and password file <none>
I20260924 12:56:13.045696 24907 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:13.045805 24907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:13.046130 24907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:13.049508 24907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "4ef12e124bed49998c71352553078853"
format_stamp: "Formatted at 2026-09-24 12:56:13 on dist-test-slave-m9hg"
server_key: "f03f1985a039dbd84478dac7f998805d"
server_key_iv: "b588e291e2648f96cf3b654e0ab7954f"
server_key_version: "encryptionkey@0"
I20260924 12:56:13.050413 24907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "4ef12e124bed49998c71352553078853"
format_stamp: "Formatted at 2026-09-24 12:56:13 on dist-test-slave-m9hg"
server_key: "f03f1985a039dbd84478dac7f998805d"
server_key_iv: "b588e291e2648f96cf3b654e0ab7954f"
server_key_version: "encryptionkey@0"
I20260924 12:56:13.057296 24907 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260924 12:56:13.061950 24922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:13.063866 24907 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:56:13.064098 24907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "4ef12e124bed49998c71352553078853"
format_stamp: "Formatted at 2026-09-24 12:56:13 on dist-test-slave-m9hg"
server_key: "f03f1985a039dbd84478dac7f998805d"
server_key_iv: "b588e291e2648f96cf3b654e0ab7954f"
server_key_version: "encryptionkey@0"
I20260924 12:56:13.064419 24907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:13.083503 24907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:13.088981 24907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:13.089353 24907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:13.113873 24973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:44001 every 8 connection(s)
I20260924 12:56:13.113873 24907 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:44001
I20260924 12:56:13.115729 24907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:56:13.117977 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 24907
I20260924 12:56:13.118260 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:56:13.119225 11461 external_mini_cluster.cc:1428] Setting key da1533af8a13f1f26e52f0edd3b2aa77
I20260924 12:56:13.122363 24974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:13.134928 24974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.49.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.125@KRBTEST.COM" created.
Sep 24 12:56:13 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254573, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:13.164489 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.139737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:44001 (local address 127.0.0.1:43940)
0924 12:56:13.140941 (+ 1204us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.141021 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:13.143696 (+ 2675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:13.144985 (+ 1289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:13.144992 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:13.145884 (+ 892us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:13.146318 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:13.146341 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.148313 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.148321 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:13.149607 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:13.149651 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.151102 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.151114 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:13.151403 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:13.152369 (+ 966us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:13.152413 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:13.156023 (+ 3610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:13.159863 (+ 3840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:13.159877 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:13.159891 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:13.160393 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:13.160831 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:13.160836 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:13.160839 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:13.161004 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:13.161866 (+ 862us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:13.161875 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:13.162094 (+ 219us) client_negotiation.cc:769] Sending connection context
0924 12:56:13.162359 (+ 265us) client_negotiation.cc:240] Negotiation successful
0924 12:56:13.162992 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"mutex_wait_us":166,"thread_start_us":525,"threads_started":1}
I20260924 12:56:13.164515 24978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.141561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43940 (local address 127.11.49.126:44001)
0924 12:56:13.142457 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:13.142468 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:13.142539 (+ 71us) server_negotiation.cc:407] Connection header received
0924 12:56:13.144313 (+ 1774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:13.144327 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:13.144699 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:13.144958 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:13.146568 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.148103 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.149913 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.150704 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.150912 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:13.156441 (+ 5529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:13.156453 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:13.156468 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:13.156510 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:13.159695 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:13.160546 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:13.160553 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:13.160555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:13.160710 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:13.161120 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:13.161131 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:13.161134 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:13.161708 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:13.161931 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:13.162483 (+ 552us) server_negotiation.cc:299] Negotiation successful
0924 12:56:13.162867 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":625,"thread_start_us":398,"threads_started":1}
I20260924 12:56:13.167698 24974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:56:13.169358 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.168761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35428)
0924 12:56:13.169023 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.169205 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260924 12:56:13.169780 24923 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
I20260924 12:56:13.171974 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.171520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35438)
0924 12:56:13.171737 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.171819 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260924 12:56:13.172472 24974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:43045: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab.
Entry for principal kudu/127.11.49.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab.
I20260924 12:56:13.188448 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.125:43045
--webserver_interface=127.11.49.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab
--principal=kudu/127.11.49.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:44001,127.11.49.125:43045,127.11.49.124:43373
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:56:13.221894 24974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } attempt: 1
I20260924 12:56:13.223445 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.222886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35446)
0924 12:56:13.223152 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.223305 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260924 12:56:13.224627 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.224206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35456)
0924 12:56:13.224412 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.224489 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260924 12:56:13.224951 24974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:43045: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
I20260924 12:56:13.293298 24974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } attempt: 2
I20260924 12:56:13.294999 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.294288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35458)
0924 12:56:13.294640 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.294821 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260924 12:56:13.296782 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.295967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35470)
0924 12:56:13.296245 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.296526 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260924 12:56:13.297135 24974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:43045: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
I20260924 12:56:13.388520 24974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } attempt: 3
I20260924 12:56:13.390321 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.389595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35480)
0924 12:56:13.389912 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.390090 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260924 12:56:13.391629 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.391145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35484)
0924 12:56:13.391321 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.391420 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260924 12:56:13.391880 24974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:43045: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
I20260924 12:56:13.535223 24974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } attempt: 4
I20260924 12:56:13.536834 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.536160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35490)
0924 12:56:13.536575 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.536667 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261}
I20260924 12:56:13.538108 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.537715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35502)
0924 12:56:13.537873 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.537988 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260924 12:56:13.538415 24974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:43045: Network error: Client connection negotiation failed: client connection to 127.11.49.125:43045: connect: Connection refused (error 111)
W20260924 12:56:13.632090 24981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:13.632547 24981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:13.632732 24981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:13.641556 24981 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:56:13.641726 24981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:13.641826 24981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:13.641957 24981 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:56:13.642027 24981 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:56:13.655716 24981 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:44001,127.11.49.125:43045,127.11.49.124:43373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab
--principal=kudu/127.11.49.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.125:43045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.49.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:13.657917 24981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:13.659785 24981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:13.676362 24986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:13.676437 24989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:13.676486 24987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:13.677510 24981 server_base.cc:1034] running on GCE node
I20260924 12:56:13.678647 24981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:13.680794 24981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:13.682111 24981 hybrid_clock.cc:648] HybridClock initialized: now 1790254573682038 us; error 50 us; skew 500 ppm
I20260924 12:56:13.682664 24981 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:13 dist-test-slave-m9hg krb5kdc[24894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254573, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:13.693907 24981 init.cc:377] Logged in from keytab as kudu/127.11.49.125@KRBTEST.COM (short username kudu)
I20260924 12:56:13.696559 24981 webserver.cc:460] Webserver started at http://127.11.49.125:43519/ using document root <none> and password file <none>
I20260924 12:56:13.697638 24981 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:13.697845 24981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:13.698264 24981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:13.702497 24981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/data/instance:
uuid: "30543a455ee44f9ab81cf1a81707750f"
format_stamp: "Formatted at 2026-09-24 12:56:13 on dist-test-slave-m9hg"
server_key: "80200ede77dee4293ef6529b58f0d866"
server_key_iv: "2e94560d42627f9e227744c7036b4d42"
server_key_version: "encryptionkey@0"
I20260924 12:56:13.703614 24981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/wal/instance:
uuid: "30543a455ee44f9ab81cf1a81707750f"
format_stamp: "Formatted at 2026-09-24 12:56:13 on dist-test-slave-m9hg"
server_key: "80200ede77dee4293ef6529b58f0d866"
server_key_iv: "2e94560d42627f9e227744c7036b4d42"
server_key_version: "encryptionkey@0"
I20260924 12:56:13.711169 24981 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260924 12:56:13.717556 24996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:13.719835 24981 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260924 12:56:13.720167 24981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/wal
uuid: "30543a455ee44f9ab81cf1a81707750f"
format_stamp: "Formatted at 2026-09-24 12:56:13 on dist-test-slave-m9hg"
server_key: "80200ede77dee4293ef6529b58f0d866"
server_key_iv: "2e94560d42627f9e227744c7036b4d42"
server_key_version: "encryptionkey@0"
I20260924 12:56:13.720563 24981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:13.749444 24981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:13.755292 24981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:13.755714 24981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:13.779306 24981 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.125:43045
I20260924 12:56:13.779366 25047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.125:43045 every 8 connection(s)
I20260924 12:56:13.781026 24981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
I20260924 12:56:13.783528 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 24981
I20260924 12:56:13.783762 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-1/wal/instance
I20260924 12:56:13.784354 11461 external_mini_cluster.cc:1428] Setting key aa0a24f45df4ce0314dc78b172daf24c
I20260924 12:56:13.786435 25048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:13.794981 25048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.49.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.124@KRBTEST.COM" created.
Sep 24 12:56:13 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254573, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:13.824676 25051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.798853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43956 (local address 127.11.49.126:44001)
0924 12:56:13.799539 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:13.799550 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:13.800929 (+ 1379us) server_negotiation.cc:407] Connection header received
0924 12:56:13.803539 (+ 2610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:13.803546 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:13.803673 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:13.803815 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:13.806113 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.807089 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.809588 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.810543 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.810779 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:13.815480 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:13.815492 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:13.815501 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:13.815576 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:13.819730 (+ 4154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:13.821118 (+ 1388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:13.821126 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:13.821129 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:13.821368 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:13.822076 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:13.822083 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:13.822085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:13.822487 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:13.822641 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:13.823820 (+ 1179us) server_negotiation.cc:299] Negotiation successful
0924 12:56:13.824181 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":388,"threads_started":1}
I20260924 12:56:13.826016 25052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.799525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:44001 (local address 127.0.0.1:43956)
0924 12:56:13.800677 (+ 1152us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.800742 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:13.803122 (+ 2380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:13.804159 (+ 1037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:13.804171 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:13.804973 (+ 802us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:13.805801 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:13.805826 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.807469 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.807476 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:13.809291 (+ 1815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:13.809313 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.810912 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.810918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:13.811190 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:13.812067 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:13.812096 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:13.815041 (+ 2945us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:13.820005 (+ 4964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:13.820019 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:13.820042 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:13.820842 (+ 800us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:13.821526 (+ 684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:13.821534 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:13.821540 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:13.821826 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:13.822651 (+ 825us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:13.822662 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:13.823249 (+ 587us) client_negotiation.cc:769] Sending connection context
0924 12:56:13.823587 (+ 338us) client_negotiation.cc:240] Negotiation successful
0924 12:56:13.824227 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"thread_start_us":449,"threads_started":1}
I20260924 12:56:13.828927 25048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:56:13.837689 24974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } attempt: 5
Sep 24 12:56:13 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254573, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab.
Entry for principal kudu/127.11.49.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab.
I20260924 12:56:13.845674 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.124:43373
--webserver_interface=127.11.49.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab
--principal=kudu/127.11.49.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:34851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:44001,127.11.49.125:43045,127.11.49.124:43373
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:56:13 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254573, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
I20260924 12:56:13.851897 25052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.830025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35510)
0924 12:56:13.830299 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.830324 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:13.830461 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:13.832056 (+ 1595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:13.832061 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:13.832714 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:13.832892 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:13.832903 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.834615 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.834622 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:13.835761 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:13.835777 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.837253 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.837263 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:13.837630 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:13.838696 (+ 1066us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:13.838726 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:13.842365 (+ 3639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:13.847939 (+ 5574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:13.847947 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:13.847955 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:13.848581 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:13.849147 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:13.849158 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:13.849161 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:13.849352 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:13.850539 (+ 1187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:13.850543 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:13.850719 (+ 176us) client_negotiation.cc:769] Sending connection context
0924 12:56:13.850913 (+ 194us) client_negotiation.cc:240] Negotiation successful
0924 12:56:13.851398 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260924 12:56:13.852422 25054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.830415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35510 (local address 127.11.49.125:43045)
0924 12:56:13.831417 (+ 1002us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:13.831425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:13.831473 (+ 48us) server_negotiation.cc:407] Connection header received
0924 12:56:13.831544 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:13.831552 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:13.831844 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:13.832091 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:13.833095 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.834415 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.835934 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.836950 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.837146 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:13.842649 (+ 5503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:13.842666 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:13.842682 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:13.842713 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:13.847696 (+ 4983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:13.848741 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:13.848752 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:13.848757 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:13.849000 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:13.849557 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:13.849567 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:13.849573 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:13.850290 (+ 717us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:13.850617 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:13.851110 (+ 493us) server_negotiation.cc:299] Negotiation successful
0924 12:56:13.851561 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":150,"server-negotiator.queue_time_us":800,"thread_start_us":567,"threads_started":1}
I20260924 12:56:13.855005 25048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:56:13.856519 25052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.855880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36060)
0924 12:56:13.856107 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.856262 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260924 12:56:13.856909 25000 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
I20260924 12:56:13.858952 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.838549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35518)
0924 12:56:13.838811 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.838833 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:13.838985 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:13.840193 (+ 1208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:13.840203 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:13.840808 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:13.841041 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:13.841053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.842627 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.842636 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:13.843565 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:13.843578 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.844647 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.844653 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:13.844851 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:13.845543 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:13.845561 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:13.847846 (+ 2285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:13.854923 (+ 7077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:13.854935 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:13.854943 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:13.855673 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:13.856327 (+ 654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:13.856336 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:13.856340 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:13.856613 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:13.857478 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:13.857487 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:13.857763 (+ 276us) client_negotiation.cc:769] Sending connection context
0924 12:56:13.857977 (+ 214us) client_negotiation.cc:240] Negotiation successful
0924 12:56:13.858474 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97}
I20260924 12:56:13.859083 25055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.838690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35518 (local address 127.11.49.125:43045)
0924 12:56:13.839670 (+ 980us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:13.839675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:13.839701 (+ 26us) server_negotiation.cc:407] Connection header received
0924 12:56:13.839758 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:13.839762 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:13.839829 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:13.839978 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:13.841313 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.842462 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.843728 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:13.844482 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:13.844634 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:13.848129 (+ 3495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:13.848139 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:13.848146 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:13.848204 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:13.854643 (+ 6439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:13.855900 (+ 1257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:13.855909 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:13.855915 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:13.856098 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:13.856806 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:13.856823 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:13.856826 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:13.857290 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:13.857501 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:13.858138 (+ 637us) server_negotiation.cc:299] Negotiation successful
0924 12:56:13.858488 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":809,"thread_start_us":404,"threads_started":1}
I20260924 12:56:13.860513 24974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:56:13.861061 25052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.860322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36062)
0924 12:56:13.860665 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.860820 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"threads_started":1}
I20260924 12:56:13.862234 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.861563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36064)
0924 12:56:13.861854 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.861988 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260924 12:56:13.863970 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.863274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36072)
0924 12:56:13.863536 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.863723 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260924 12:56:13.864368 24974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:43373: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
W20260924 12:56:13.868176 25048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:43373: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
I20260924 12:56:13.915735 24974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } attempt: 1
I20260924 12:56:13.917402 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.916851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36084)
0924 12:56:13.917066 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.917214 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260924 12:56:13.917701 25048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } attempt: 1
I20260924 12:56:13.919057 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.918404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36108)
0924 12:56:13.918688 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.918857 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260924 12:56:13.919324 25058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.918397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36092)
0924 12:56:13.918733 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.918939 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
W20260924 12:56:13.919348 24974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:43373: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
I20260924 12:56:13.920646 25058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.920261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36122)
0924 12:56:13.920459 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.920538 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260924 12:56:13.920982 25048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:43373: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
I20260924 12:56:13.987640 24974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } attempt: 2
I20260924 12:56:13.989248 25048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } attempt: 2
I20260924 12:56:13.989408 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.988594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36126)
0924 12:56:13.988972 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.989129 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260924 12:56:13.990653 25058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.989940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36138)
0924 12:56:13.990237 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.990414 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260924 12:56:13.990754 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.990293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36146)
0924 12:56:13.990494 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.990579 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260924 12:56:13.991068 24974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:43373: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
I20260924 12:56:13.991807 25058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:13.991384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36162)
0924 12:56:13.991558 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:13.991658 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260924 12:56:13.992079 25048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:43373: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
I20260924 12:56:14.083395 25048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } attempt: 3
I20260924 12:56:14.085255 25058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.084524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36174)
0924 12:56:14.084823 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.084985 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260924 12:56:14.087018 25058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.086350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36178)
0924 12:56:14.086685 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.086828 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
W20260924 12:56:14.087355 25048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:43373: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
I20260924 12:56:14.097364 24974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } attempt: 3
I20260924 12:56:14.099066 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.098357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36190)
0924 12:56:14.098653 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.098802 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260924 12:56:14.100667 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.099962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36200)
0924 12:56:14.100232 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.100430 (+ 198us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
W20260924 12:56:14.101033 24974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:43373: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
I20260924 12:56:14.230664 25048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } attempt: 4
I20260924 12:56:14.232139 25058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.231371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36214)
0924 12:56:14.231693 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.231862 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260924 12:56:14.233803 25058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.233227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36222)
0924 12:56:14.233435 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.233584 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260924 12:56:14.234151 25048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:43373: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
I20260924 12:56:14.278364 24974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } attempt: 4
I20260924 12:56:14.280011 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.279313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36226)
0924 12:56:14.279623 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.279768 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260924 12:56:14.281518 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.281016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36232)
0924 12:56:14.281213 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.281324 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260924 12:56:14.281888 24974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:43373: Network error: Client connection negotiation failed: client connection to 127.11.49.124:43373: connect: Connection refused (error 111)
W20260924 12:56:14.302668 25056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:14.303092 25056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:14.303309 25056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:14.311858 25056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:56:14.312038 25056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:14.312140 25056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:14.312238 25056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:56:14.312361 25056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:56:14.324518 25056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:34851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:44001,127.11.49.125:43045,127.11.49.124:43373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab
--principal=kudu/127.11.49.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.124:43373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.49.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:14.326577 25056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:14.328430 25056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:14.344969 25063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:14.345036 25064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:14.345002 25066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:14.346113 25056 server_base.cc:1034] running on GCE node
I20260924 12:56:14.347280 25056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:14.349442 25056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:14.350752 25056 hybrid_clock.cc:648] HybridClock initialized: now 1790254574350685 us; error 67 us; skew 500 ppm
I20260924 12:56:14.351294 25056 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:14 dist-test-slave-m9hg krb5kdc[24894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254574, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:14.355697 25056 init.cc:377] Logged in from keytab as kudu/127.11.49.124@KRBTEST.COM (short username kudu)
I20260924 12:56:14.358129 25056 webserver.cc:460] Webserver started at http://127.11.49.124:37659/ using document root <none> and password file <none>
I20260924 12:56:14.359136 25056 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:14.359318 25056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:14.359719 25056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:14.364941 25056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/data/instance:
uuid: "6dcf42c80ca04cc688a7d39c073bdfcd"
format_stamp: "Formatted at 2026-09-24 12:56:14 on dist-test-slave-m9hg"
server_key: "d5ad226361c6f054340221c516cee3b3"
server_key_iv: "733e028e8bc54e9712832b3497f2e007"
server_key_version: "encryptionkey@0"
I20260924 12:56:14.366159 25056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/wal/instance:
uuid: "6dcf42c80ca04cc688a7d39c073bdfcd"
format_stamp: "Formatted at 2026-09-24 12:56:14 on dist-test-slave-m9hg"
server_key: "d5ad226361c6f054340221c516cee3b3"
server_key_iv: "733e028e8bc54e9712832b3497f2e007"
server_key_version: "encryptionkey@0"
I20260924 12:56:14.373749 25056 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260924 12:56:14.378738 25073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:14.380900 25056 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:56:14.381206 25056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/wal
uuid: "6dcf42c80ca04cc688a7d39c073bdfcd"
format_stamp: "Formatted at 2026-09-24 12:56:14 on dist-test-slave-m9hg"
server_key: "d5ad226361c6f054340221c516cee3b3"
server_key_iv: "733e028e8bc54e9712832b3497f2e007"
server_key_version: "encryptionkey@0"
I20260924 12:56:14.381491 25056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:14.405695 25056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:14.411676 25056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:14.412101 25056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:14.437558 25124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.124:43373 every 8 connection(s)
I20260924 12:56:14.437806 25056 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.124:43373
I20260924 12:56:14.440035 25056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
I20260924 12:56:14.444911 25125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:14.445609 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 25056
I20260924 12:56:14.445868 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790254326970360-11461-0/minicluster-data/master-2/wal/instance
I20260924 12:56:14.446473 11461 external_mini_cluster.cc:1428] Setting key ff8708494becda7e1e280bef3ce4c999
I20260924 12:56:14.455899 25125 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:56:14 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
Sep 24 12:56:14 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254574, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:14.481966 25128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.449029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36242 (local address 127.11.49.124:43373)
0924 12:56:14.450187 (+ 1158us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:14.450201 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:14.450264 (+ 63us) server_negotiation.cc:407] Connection header received
0924 12:56:14.452229 (+ 1965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:14.452259 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:14.452970 (+ 711us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:14.453434 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:14.455464 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.457320 (+ 1856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.459555 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.461112 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.461406 (+ 294us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.466847 (+ 5441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:14.466858 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:14.466875 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:14.466934 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:14.475036 (+ 8102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.476208 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.476219 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.476229 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.476517 (+ 288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.477104 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.477109 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.477113 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.478056 (+ 943us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:14.478405 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:14.479188 (+ 783us) server_negotiation.cc:299] Negotiation successful
0924 12:56:14.480250 (+ 1062us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":868,"thread_start_us":546,"threads_started":1}
I20260924 12:56:14.489575 25130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.459836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:44001 (local address 127.0.0.1:43964)
0924 12:56:14.461029 (+ 1193us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.461104 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:14.461364 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:14.462050 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:14.462062 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:14.462939 (+ 877us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:14.463302 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:14.463312 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.464974 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.464982 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:14.466565 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:14.466596 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.467451 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.467458 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:14.467720 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.468560 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:14.468591 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:14.476017 (+ 7426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:14.485159 (+ 9142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:14.485177 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:14.485186 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:14.486035 (+ 849us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:14.486793 (+ 758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:14.486801 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:14.486808 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:14.487026 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:14.488013 (+ 987us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:14.488025 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:14.488312 (+ 287us) client_negotiation.cc:769] Sending connection context
0924 12:56:14.488567 (+ 255us) client_negotiation.cc:240] Negotiation successful
0924 12:56:14.489009 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"thread_start_us":733,"threads_started":1}
I20260924 12:56:14.490291 25129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.459822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43964 (local address 127.11.49.126:44001)
0924 12:56:14.460596 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:14.460606 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:14.461220 (+ 614us) server_negotiation.cc:407] Connection header received
0924 12:56:14.461565 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:14.461572 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:14.461668 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:14.461868 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:14.463499 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.464731 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.466810 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.467222 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.467335 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.476430 (+ 9095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:14.476440 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:14.476445 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:14.476498 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:14.484878 (+ 8380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.486317 (+ 1439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.486326 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.486330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.486611 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.487184 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.487191 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.487197 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.487725 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:14.487926 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:14.488870 (+ 944us) server_negotiation.cc:299] Negotiation successful
0924 12:56:14.489507 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":302,"threads_started":1}
I20260924 12:56:14.492542 25125 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:56:14 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254574, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
Sep 24 12:56:14 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:14.514407 25130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.493436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:43045 (local address 127.0.0.1:35522)
0924 12:56:14.493611 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.493633 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:14.493763 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:14.495195 (+ 1432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:14.495201 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:14.495830 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:14.496050 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:14.496062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.497764 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.497771 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:14.499213 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:14.499231 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.500312 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.500319 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:14.500782 (+ 463us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.501545 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:14.501578 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:14.505254 (+ 3676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:14.510893 (+ 5639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:14.510904 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:14.510910 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:14.511557 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:14.512035 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:14.512041 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:14.512045 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:14.512325 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:14.513161 (+ 836us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:14.513167 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:14.513379 (+ 212us) client_negotiation.cc:769] Sending connection context
0924 12:56:14.513587 (+ 208us) client_negotiation.cc:240] Negotiation successful
0924 12:56:14.513983 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260924 12:56:14.514958 25129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.486415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43976 (local address 127.11.49.126:44001)
0924 12:56:14.491914 (+ 5499us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:14.491924 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:14.491948 (+ 24us) server_negotiation.cc:407] Connection header received
0924 12:56:14.492026 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:14.492035 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:14.492195 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:14.493183 (+ 988us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:14.494878 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.496096 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.497810 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.498547 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.498666 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.507246 (+ 8580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:14.507257 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:14.507263 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:14.507324 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:14.511026 (+ 3702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.512213 (+ 1187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.512220 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.512223 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.512465 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.512998 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.513005 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.513008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.513471 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:14.513825 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:14.514274 (+ 449us) server_negotiation.cc:299] Negotiation successful
0924 12:56:14.514591 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5328,"thread_start_us":7785,"threads_started":1}
I20260924 12:56:14.515967 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.493683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35522 (local address 127.11.49.125:43045)
0924 12:56:14.494754 (+ 1071us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:14.494762 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:14.494787 (+ 25us) server_negotiation.cc:407] Connection header received
0924 12:56:14.494864 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:14.494873 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:14.494961 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:14.495102 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:14.496299 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.497576 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.499459 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.500094 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.500230 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.505753 (+ 5523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:14.505760 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:14.505764 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:14.505818 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:14.510607 (+ 4789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.511729 (+ 1122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.511735 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.511738 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.511904 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.512495 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.512504 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.512511 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.512998 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:14.513208 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:14.515081 (+ 1873us) server_negotiation.cc:299] Negotiation successful
0924 12:56:14.515408 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":876,"thread_start_us":728,"threads_started":1}
I20260924 12:56:14.517465 25125 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:56:14 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254574, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
Sep 24 12:56:14 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
I20260924 12:56:14.533444 25048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } attempt: 5
I20260924 12:56:14.536516 25128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.518536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36246 (local address 127.11.49.124:43373)
0924 12:56:14.518751 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:14.518759 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:14.519016 (+ 257us) server_negotiation.cc:407] Connection header received
0924 12:56:14.519361 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:14.519369 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:14.519455 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:14.519578 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:14.520867 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.521643 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.523032 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.523757 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.523863 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.528737 (+ 4874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:14.528742 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:14.528745 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:14.528779 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:14.532082 (+ 3303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.533271 (+ 1189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.533284 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.533291 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.533585 (+ 294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.534195 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.534203 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.534208 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.534725 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:14.534909 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:14.535557 (+ 648us) server_negotiation.cc:299] Negotiation successful
0924 12:56:14.535939 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260924 12:56:14.540151 25130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.518662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36246)
0924 12:56:14.518923 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.518944 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:14.519086 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:14.519701 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:14.519709 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:14.520386 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:14.520663 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:14.520679 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.521794 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.521802 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:14.522860 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:14.522876 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.524152 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.524157 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:14.524396 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.525236 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:14.525254 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:14.528507 (+ 3253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:14.532376 (+ 3869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:14.532384 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:14.532393 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:14.533023 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:14.533826 (+ 803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:14.533835 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:14.533843 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:14.534052 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:14.535007 (+ 955us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:14.535014 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:14.535221 (+ 207us) client_negotiation.cc:769] Sending connection context
0924 12:56:14.538879 (+ 3658us) client_negotiation.cc:240] Negotiation successful
0924 12:56:14.539615 (+ 736us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143}
I20260924 12:56:14.546732 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.517801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35538 (local address 127.11.49.125:43045)
0924 12:56:14.518022 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:14.518030 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:14.518189 (+ 159us) server_negotiation.cc:407] Connection header received
0924 12:56:14.518674 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:14.518681 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:14.518800 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:14.518908 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:14.520928 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.522515 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.524756 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.525767 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.526014 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.535478 (+ 9464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:14.535490 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:14.535498 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:14.535560 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:14.541191 (+ 5631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.542664 (+ 1473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.542671 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.542674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.542937 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.543515 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.543519 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.543522 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.543966 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:14.545754 (+ 1788us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:14.545915 (+ 161us) server_negotiation.cc:299] Negotiation successful
0924 12:56:14.546266 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Sep 24 12:56:14 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254573, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
I20260924 12:56:14.549291 25125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd: Bootstrap starting.
I20260924 12:56:14.554245 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:56:14.555894 25125 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:14.557734 25125 log.cc:824] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:14.560159 25058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.534281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36260)
0924 12:56:14.534516 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.534542 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:14.534689 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:14.537417 (+ 2728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:14.537426 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:14.538272 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:14.538728 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:14.538748 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.541448 (+ 2700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.541459 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:14.543346 (+ 1887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:14.543384 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.545107 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.545117 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:14.545402 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.546344 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:14.546378 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:14.550324 (+ 3946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:14.555894 (+ 5570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:14.555902 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:14.555907 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:14.556653 (+ 746us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:14.557226 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:14.557232 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:14.557236 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:14.557438 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:14.558489 (+ 1051us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:14.558496 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:14.558709 (+ 213us) client_negotiation.cc:769] Sending connection context
0924 12:56:14.558924 (+ 215us) client_negotiation.cc:240] Negotiation successful
0924 12:56:14.559475 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260924 12:56:14.561053 24974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } attempt: 5
I20260924 12:56:14.561651 25128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.534765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36260 (local address 127.11.49.124:43373)
0924 12:56:14.536898 (+ 2133us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:14.536903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:14.536923 (+ 20us) server_negotiation.cc:407] Connection header received
0924 12:56:14.537015 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:14.537024 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:14.537132 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:14.538143 (+ 1011us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:14.538977 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.540761 (+ 1784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.543680 (+ 2919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.544837 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.550614 (+ 5777us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.550971 (+ 357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:14.550980 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:14.550988 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:14.551028 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:14.555638 (+ 4610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.556837 (+ 1199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.556844 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.556847 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.557068 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.557611 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.557616 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.557619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.558194 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:14.558396 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:14.560651 (+ 2255us) server_negotiation.cc:299] Negotiation successful
0924 12:56:14.561035 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2023,"thread_start_us":3130,"threads_started":1}
I20260924 12:56:14.568543 25125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd: No bootstrap required, opened a new log
I20260924 12:56:14.569767 25048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f: Bootstrap starting.
Sep 24 12:56:14 dist-test-slave-m9hg krb5kdc[24894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254573, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
I20260924 12:56:14.576042 25048 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:14.578778 25048 log.cc:824] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:14.583655 25125 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } }
I20260924 12:56:14.584468 25125 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:14.584650 25125 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dcf42c80ca04cc688a7d39c073bdfcd, State: Initialized, Role: FOLLOWER
I20260924 12:56:14.585688 25125 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } }
I20260924 12:56:14.592027 25048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f: No bootstrap required, opened a new log
I20260924 12:56:14.592550 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.561950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:43373 (local address 127.0.0.1:36266)
0924 12:56:14.562260 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:14.562288 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:14.562437 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:14.563054 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:14.563059 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:14.563657 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:14.563943 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:14.563969 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.565839 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.565849 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:14.567581 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:14.567606 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.569065 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.569072 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:14.569300 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.570205 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:14.570231 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:14.573745 (+ 3514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:14.588569 (+ 14824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:14.588581 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:14.588588 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:14.589364 (+ 776us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:14.589994 (+ 630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:14.590001 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:14.590008 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:14.590232 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:14.591064 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:14.591071 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:14.591282 (+ 211us) client_negotiation.cc:769] Sending connection context
0924 12:56:14.591447 (+ 165us) client_negotiation.cc:240] Negotiation successful
0924 12:56:14.591865 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120}
I20260924 12:56:14.593966 25128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.562551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36266 (local address 127.11.49.124:43373)
0924 12:56:14.562702 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:14.562707 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:14.562723 (+ 16us) server_negotiation.cc:407] Connection header received
0924 12:56:14.562775 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:14.562780 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:14.562860 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:14.564132 (+ 1272us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:14.564384 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.565627 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.567918 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.568718 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.571424 (+ 2706us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.574066 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:14.574073 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:14.574079 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:14.574124 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:14.582595 (+ 8471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.589609 (+ 7014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.589617 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.589623 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.589833 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.590412 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.590419 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.590424 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.590905 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:14.592914 (+ 2009us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:14.593108 (+ 194us) server_negotiation.cc:299] Negotiation successful
0924 12:56:14.593458 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260924 12:56:14.604130 24974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853: Bootstrap starting.
I20260924 12:56:14.611549 24974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:14.621749 25139 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } } }
I20260924 12:56:14.622870 25139 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:56:14.623826 25125 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:56:14.627220 24974 log.cc:824] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:14.642518 25048 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } }
I20260924 12:56:14.643317 25048 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:14.643471 25048 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30543a455ee44f9ab81cf1a81707750f, State: Initialized, Role: FOLLOWER
I20260924 12:56:14.644658 25048 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } }
I20260924 12:56:14.650542 24974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853: No bootstrap required, opened a new log
W20260924 12:56:14.665307 25079 tablet.cc:2369] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:56:14.667689 24974 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } }
I20260924 12:56:14.669407 24974 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:14.669842 24974 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef12e124bed49998c71352553078853, State: Initialized, Role: FOLLOWER
I20260924 12:56:14.671218 24974 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } }
I20260924 12:56:14.674137 25048 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:56:14.679642 25148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } } }
I20260924 12:56:14.683713 25148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:56:14.683441 24974 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:56:14.684764 25146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } } }
I20260924 12:56:14.685398 25146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:56:14.725492 25129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.636111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43992 (local address 127.11.49.126:44001)
0924 12:56:14.636521 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:14.636534 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:14.645117 (+ 8583us) server_negotiation.cc:407] Connection header received
0924 12:56:14.645503 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:14.645513 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:14.645626 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:14.645712 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:14.656475 (+ 10763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.658250 (+ 1775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.675183 (+ 16933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.676235 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.676408 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.701216 (+ 24808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:14.701228 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:14.701237 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:14.701311 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:14.707144 (+ 5833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.717711 (+ 10567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.717722 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.717729 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.718002 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.718569 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.718577 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.718583 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.719099 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:14.719499 (+ 400us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:14.724426 (+ 4927us) server_negotiation.cc:299] Negotiation successful
0924 12:56:14.724865 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224}
I20260924 12:56:14.731618 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.637000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35550 (local address 127.11.49.125:43045)
0924 12:56:14.637254 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:14.637264 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:14.649656 (+ 12392us) server_negotiation.cc:407] Connection header received
0924 12:56:14.649995 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:14.650005 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:14.650129 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:14.650227 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:14.661320 (+ 11093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.664598 (+ 3278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.690138 (+ 25540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.691174 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.691329 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.710922 (+ 19593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:14.710933 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:14.710941 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:14.711063 (+ 122us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:14.716309 (+ 5246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.723506 (+ 7197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.723518 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.723524 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.723791 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.728410 (+ 4619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.728421 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.728427 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.729113 (+ 686us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:14.729508 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:14.730536 (+ 1028us) server_negotiation.cc:299] Negotiation successful
0924 12:56:14.730948 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260924 12:56:14.742264 25175 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260924 12:56:14.748199 25128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:14.637022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36272 (local address 127.11.49.124:43373)
0924 12:56:14.637484 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:14.637492 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:14.670477 (+ 32985us) server_negotiation.cc:407] Connection header received
0924 12:56:14.671671 (+ 1194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:14.671682 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:14.671937 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:14.672049 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:14.696766 (+ 24717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.698272 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.708315 (+ 10043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:14.709192 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:14.709341 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:14.738286 (+ 28945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:14.738294 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:14.738299 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:14.738371 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:14.743360 (+ 4989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.744727 (+ 1367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.744734 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.744737 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.744942 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:14.745527 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:14.745532 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:14.745535 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:14.745990 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:14.746610 (+ 620us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:14.747376 (+ 766us) server_negotiation.cc:299] Negotiation successful
0924 12:56:14.747740 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272}
W20260924 12:56:14.759450 25002 tablet.cc:2369] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:56:14.766625 25179 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260924 12:56:14.769953 25139 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:56:14.770324 25139 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } }
I20260924 12:56:14.745702 24981 master_runner.cc:186] Error getting master registration for 127.11.49.126:44001: OK, instance_id { permanent_uuid: "4ef12e124bed49998c71352553078853" instance_seqno: 1790254573106941 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 12:56:14.761458 25056 master_runner.cc:186] Error getting master registration for 127.11.49.126:44001: OK, instance_id { permanent_uuid: "4ef12e124bed49998c71352553078853" instance_seqno: 1790254573106941 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 12:56:14.773609 24949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef12e124bed49998c71352553078853" is_pre_election: true
I20260924 12:56:14.773890 25023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30543a455ee44f9ab81cf1a81707750f" is_pre_election: true
I20260924 12:56:14.774480 24949 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dcf42c80ca04cc688a7d39c073bdfcd in term 0.
I20260924 12:56:14.774875 25023 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dcf42c80ca04cc688a7d39c073bdfcd in term 0.
I20260924 12:56:14.773191 25139 leader_election.cc:288] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ef12e124bed49998c71352553078853 (127.11.49.126:44001), 30543a455ee44f9ab81cf1a81707750f (127.11.49.125:43045)
I20260924 12:56:14.775518 25076 leader_election.cc:302] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ef12e124bed49998c71352553078853, 6dcf42c80ca04cc688a7d39c073bdfcd; no voters:
I20260924 12:56:14.776085 25139 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:56:14.776304 25139 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:56:14.776458 25139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:14.772991 24981 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260924 12:56:14.780320 25139 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } }
I20260924 12:56:14.781190 25056 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260924 12:56:14.781709 24949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef12e124bed49998c71352553078853"
I20260924 12:56:14.781989 24949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:14.785854 24949 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dcf42c80ca04cc688a7d39c073bdfcd in term 1.
I20260924 12:56:14.786540 25076 leader_election.cc:302] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ef12e124bed49998c71352553078853, 6dcf42c80ca04cc688a7d39c073bdfcd; no voters:
I20260924 12:56:14.787992 24907 master_runner.cc:232] Existing masters have differing terms: 0 vs 1
I20260924 12:56:14.788456 24907 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260924 12:56:14.789323 25022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30543a455ee44f9ab81cf1a81707750f"
I20260924 12:56:14.789746 25022 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:14.794103 25022 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dcf42c80ca04cc688a7d39c073bdfcd in term 1.
W20260924 12:56:14.792213 25178 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 12:56:14.799137 25178 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 12:56:14.794816 25139 leader_election.cc:288] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [CANDIDATE]: Term 1 election: Requested vote from peers 4ef12e124bed49998c71352553078853 (127.11.49.126:44001), 30543a455ee44f9ab81cf1a81707750f (127.11.49.125:43045)
I20260924 12:56:14.799556 25139 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:56:14.799758 25139 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [term 1 LEADER]: Becoming Leader. State: Replica: 6dcf42c80ca04cc688a7d39c073bdfcd, State: Running, Role: LEADER
I20260924 12:56:14.800570 25139 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } }
I20260924 12:56:14.818069 25181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6dcf42c80ca04cc688a7d39c073bdfcd. Latest consensus state: current_term: 1 leader_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } } }
I20260924 12:56:14.818668 25181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:14.824946 25183 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:56:14.827873 25183 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260924 12:56:14.843603 24928 tablet.cc:2369] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:56:14.847084 24949 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [term 1 FOLLOWER]: Refusing update from remote peer 6dcf42c80ca04cc688a7d39c073bdfcd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:56:14.848438 25139 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:56:14.848989 25022 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [term 1 FOLLOWER]: Refusing update from remote peer 6dcf42c80ca04cc688a7d39c073bdfcd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:56:14.852582 25139 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:56:14.880749 25148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6dcf42c80ca04cc688a7d39c073bdfcd. Latest consensus state: current_term: 1 leader_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } } }
I20260924 12:56:14.881354 25148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:56:14.884593 25146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6dcf42c80ca04cc688a7d39c073bdfcd. Latest consensus state: current_term: 1 leader_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } } }
I20260924 12:56:14.885300 25146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:56:14.898692 25181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } } }
I20260924 12:56:14.899433 25181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:14.899573 25146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } } }
I20260924 12:56:14.899904 25146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:56:14.899763 25181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } } }
I20260924 12:56:14.900858 25183 catalog_manager.cc:1347] Generated new cluster ID: 7a2f0a761c284317b1b9ad3c4fdd7baf
I20260924 12:56:14.901279 25183 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:56:14.901994 25185 mvcc.cc:205] Tried to move back new op lower bound from 7332882738553655296 to 7332882738389540864. Current Snapshot: MvccSnapshot[applied={T|T < 7332882738553655296}]
I20260924 12:56:14.901275 25181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:14.905777 25186 mvcc.cc:205] Tried to move back new op lower bound from 7332882738553655296 to 7332882738389540864. Current Snapshot: MvccSnapshot[applied={T|T < 7332882738553655296 or (T in {7332882738553655296})}]
I20260924 12:56:14.910516 25148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef12e124bed49998c71352553078853" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44001 } } peers { permanent_uuid: "30543a455ee44f9ab81cf1a81707750f" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 43045 } } peers { permanent_uuid: "6dcf42c80ca04cc688a7d39c073bdfcd" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 43373 } } }
I20260924 12:56:14.910936 25148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:56:14.928738 25183 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:56:14.931505 25183 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:56:14.960628 25183 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6dcf42c80ca04cc688a7d39c073bdfcd: Generated new TSK 0
I20260924 12:56:14.962016 25183 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:56:15.749182 25175 catalog_manager.cc:1259] Loaded cluster ID: 7a2f0a761c284317b1b9ad3c4fdd7baf
I20260924 12:56:15.749402 25175 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f: loading cluster ID for follower catalog manager: success
I20260924 12:56:15.753603 25175 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f: acquiring CA information for follower catalog manager: success
I20260924 12:56:15.756790 25175 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 30543a455ee44f9ab81cf1a81707750f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 12:56:15.773219 25179 catalog_manager.cc:1259] Loaded cluster ID: 7a2f0a761c284317b1b9ad3c4fdd7baf
I20260924 12:56:15.773378 25179 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853: loading cluster ID for follower catalog manager: success
I20260924 12:56:15.777837 25179 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853: acquiring CA information for follower catalog manager: success
I20260924 12:56:15.780886 25179 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4ef12e124bed49998c71352553078853: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 12:56:16.081562 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 24907
I20260924 12:56:16.083410 24969 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:16.225545 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 24907
I20260924 12:56:16.250614 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 24981
I20260924 12:56:16.252110 25043 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:16.386832 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 24981
I20260924 12:56:16.409329 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 25056
I20260924 12:56:16.410979 25120 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:16.549680 25205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:16.542229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:44001 (local address 127.0.0.1:33156)
0924 12:56:16.549236 (+ 7007us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:16.549421 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:44001: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6843,"threads_started":1}
I20260924 12:56:16.550206 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 25056
2026-09-24T12:56:16Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5425 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:56:16 dist-test-slave-m9hg krb5kdc[25208](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:56:16 dist-test-slave-m9hg krb5kdc[25208](info): set up 2 sockets
Sep 24 12:56:16 dist-test-slave-m9hg krb5kdc[25208](info): commencing operation
krb5kdc: starting...
W20260924 12:56:17.765208 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:56:17 dist-test-slave-m9hg krb5kdc[25208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:56:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:56:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:56:18.060820 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:44295
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:38567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:44295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:18.497225 25221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:18.497766 25221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:18.497972 25221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:18.506768 25221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:56:18.507022 25221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:18.507150 25221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:18.507265 25221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:56:18.507347 25221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:56:18.520710 25221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:38567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:44295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:44295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:18.522679 25221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:18.524515 25221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:18.541064 25229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:18.541190 25227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:18.541030 25226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:18.547241 25221 server_base.cc:1034] running on GCE node
I20260924 12:56:18.548475 25221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:18.550545 25221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:18.551909 25221 hybrid_clock.cc:648] HybridClock initialized: now 1790254578551758 us; error 100 us; skew 500 ppm
I20260924 12:56:18.552618 25221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:18 dist-test-slave-m9hg krb5kdc[25208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254578, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:18.557090 25221 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:56:18.559587 25221 webserver.cc:460] Webserver started at http://127.11.49.126:40153/ using document root <none> and password file <none>
I20260924 12:56:18.560766 25221 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:18.560989 25221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:18.561407 25221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:18.565587 25221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "a09ada3716454a468e433023675b116a"
format_stamp: "Formatted at 2026-09-24 12:56:18 on dist-test-slave-m9hg"
server_key: "9079dfae0bf5d7e6cc932402c727963e"
server_key_iv: "0f1fee10dc4ed9f2d065120ae25fe7af"
server_key_version: "encryptionkey@0"
I20260924 12:56:18.566697 25221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "a09ada3716454a468e433023675b116a"
format_stamp: "Formatted at 2026-09-24 12:56:18 on dist-test-slave-m9hg"
server_key: "9079dfae0bf5d7e6cc932402c727963e"
server_key_iv: "0f1fee10dc4ed9f2d065120ae25fe7af"
server_key_version: "encryptionkey@0"
I20260924 12:56:18.574280 25221 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260924 12:56:18.580418 25236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:18.583309 25221 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.001s
I20260924 12:56:18.583680 25221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "a09ada3716454a468e433023675b116a"
format_stamp: "Formatted at 2026-09-24 12:56:18 on dist-test-slave-m9hg"
server_key: "9079dfae0bf5d7e6cc932402c727963e"
server_key_iv: "0f1fee10dc4ed9f2d065120ae25fe7af"
server_key_version: "encryptionkey@0"
I20260924 12:56:18.584000 25221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:18.608706 25221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:18.615551 25221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:18.616029 25221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:18.642333 25221 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:44295
I20260924 12:56:18.642387 25287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:44295 every 8 connection(s)
I20260924 12:56:18.644176 25221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:56:18.648908 25288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:18.652560 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 25221
I20260924 12:56:18.652868 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:56:18.653844 11461 external_mini_cluster.cc:1428] Setting key ba53f58421dffdcce6b90e28ed0dbc14
I20260924 12:56:18.664487 25288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a: Bootstrap starting.
I20260924 12:56:18.668113 25288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:18.669617 25288 log.cc:824] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a: Log is configured to *not* fsync() on all Append() calls
Sep 24 12:56:18 dist-test-slave-m9hg krb5kdc[25208](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:18.673856 25288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a: No bootstrap required, opened a new log
I20260924 12:56:18.683436 25288 raft_consensus.cc:348] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09ada3716454a468e433023675b116a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44295 } }
I20260924 12:56:18.684060 25288 raft_consensus.cc:374] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:18.684243 25288 raft_consensus.cc:729] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09ada3716454a468e433023675b116a, State: Initialized, Role: FOLLOWER
I20260924 12:56:18.685072 25288 consensus_queue.cc:260] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09ada3716454a468e433023675b116a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44295 } }
I20260924 12:56:18.685392 25288 raft_consensus.cc:388] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:56:18.685590 25288 raft_consensus.cc:482] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:56:18.685777 25288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:18.686133 25291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:18.656610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59884 (local address 127.11.49.126:44295)
0924 12:56:18.657689 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:18.657708 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:18.657764 (+ 56us) server_negotiation.cc:407] Connection header received
0924 12:56:18.659995 (+ 2231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:18.660035 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:18.660770 (+ 735us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:18.661352 (+ 582us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:18.663311 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:18.665218 (+ 1907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:18.666862 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:18.667741 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:18.668005 (+ 264us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:18.674390 (+ 6385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:18.674408 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:18.674431 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:18.674498 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:18.679050 (+ 4552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:18.680489 (+ 1439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:18.680500 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:18.680509 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:18.680809 (+ 300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:18.681384 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:18.681388 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:18.681391 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:18.682261 (+ 870us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:18.682699 (+ 438us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:18.683286 (+ 587us) server_negotiation.cc:299] Negotiation successful
0924 12:56:18.683933 (+ 647us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":469,"threads_started":1}
I20260924 12:56:18.688699 25288 raft_consensus.cc:504] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09ada3716454a468e433023675b116a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44295 } }
I20260924 12:56:18.689406 25288 leader_election.cc:302] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a09ada3716454a468e433023675b116a; no voters:
I20260924 12:56:18.690209 25288 leader_election.cc:288] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:56:18.690457 25293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:56:18.692131 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:56:18.692298 25293 raft_consensus.cc:686] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [term 1 LEADER]: Becoming Leader. State: Replica: a09ada3716454a468e433023675b116a, State: Running, Role: LEADER
I20260924 12:56:18.693006 25288 sys_catalog.cc:564] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:56:18.693107 25293 consensus_queue.cc:237] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09ada3716454a468e433023675b116a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44295 } }
I20260924 12:56:18.697065 25295 sys_catalog.cc:455] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a09ada3716454a468e433023675b116a. Latest consensus state: current_term: 1 leader_uuid: "a09ada3716454a468e433023675b116a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09ada3716454a468e433023675b116a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44295 } } }
I20260924 12:56:18.697799 25295 sys_catalog.cc:458] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:18.698693 25294 sys_catalog.cc:455] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a09ada3716454a468e433023675b116a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09ada3716454a468e433023675b116a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 44295 } } }
I20260924 12:56:18.699149 25294 sys_catalog.cc:458] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:18.699218 25301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:56:18.706444 25301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:56:18.722213 25301 catalog_manager.cc:1347] Generated new cluster ID: 534c2a8db9594febb9d5659c544b2ed2
I20260924 12:56:18.722404 25301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:56:18.763273 25301 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:56:18.765185 25301 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:56:18.780834 25301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a09ada3716454a468e433023675b116a: Generated new TSK 0
I20260924 12:56:18.782045 25301 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:56:18.809095 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 25221
I20260924 12:56:18.810686 25283 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:18.925531 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 25221
2026-09-24T12:56:18Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2374 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:56:19 dist-test-slave-m9hg krb5kdc[25316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:56:19 dist-test-slave-m9hg krb5kdc[25316](info): set up 2 sockets
Sep 24 12:56:19 dist-test-slave-m9hg krb5kdc[25316](info): commencing operation
krb5kdc: starting...
W20260924 12:56:20.101500 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:56:20 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:56:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:56:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:56:20.398533 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38385
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:38385
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:20.861922 25329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:20.862712 25329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:20.863054 25329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:20.884959 25329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:56:20.885329 25329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:20.885502 25329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:20.885681 25329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:56:20.885814 25329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:56:20.904199 25329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:38385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:20.906217 25329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:20.908574 25329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:20.928063 25335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:20.928956 25337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:20.929386 25334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:20.930377 25329 server_base.cc:1034] running on GCE node
I20260924 12:56:20.931643 25329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:20.933960 25329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:20.937456 25329 hybrid_clock.cc:648] HybridClock initialized: now 1790254580937368 us; error 93 us; skew 500 ppm
I20260924 12:56:20.938043 25329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:20 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254580, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:20.941735 25329 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:56:20.944047 25329 webserver.cc:460] Webserver started at http://127.11.49.126:36037/ using document root <none> and password file <none>
I20260924 12:56:20.944932 25329 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:20.945060 25329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:20.945345 25329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:20.948786 25329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "6012d4b525534aa1abbbfa2dbdb939f5"
format_stamp: "Formatted at 2026-09-24 12:56:20 on dist-test-slave-m9hg"
server_key: "30b45a6e8c077bef91eee29473ec8fe4"
server_key_iv: "7fcb5c7f9ff8ddf31c548623d02c6f63"
server_key_version: "encryptionkey@0"
I20260924 12:56:20.949684 25329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "6012d4b525534aa1abbbfa2dbdb939f5"
format_stamp: "Formatted at 2026-09-24 12:56:20 on dist-test-slave-m9hg"
server_key: "30b45a6e8c077bef91eee29473ec8fe4"
server_key_iv: "7fcb5c7f9ff8ddf31c548623d02c6f63"
server_key_version: "encryptionkey@0"
I20260924 12:56:20.956805 25329 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260924 12:56:20.961707 25344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:20.963752 25329 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260924 12:56:20.964020 25329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "6012d4b525534aa1abbbfa2dbdb939f5"
format_stamp: "Formatted at 2026-09-24 12:56:20 on dist-test-slave-m9hg"
server_key: "30b45a6e8c077bef91eee29473ec8fe4"
server_key_iv: "7fcb5c7f9ff8ddf31c548623d02c6f63"
server_key_version: "encryptionkey@0"
I20260924 12:56:20.964260 25329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:20.991245 25329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:20.996248 25329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:20.996649 25329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:21.019981 25329 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:38385
I20260924 12:56:21.020093 25395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:38385 every 8 connection(s)
I20260924 12:56:21.021698 25329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:56:21.027029 25396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:21.031756 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 25329
I20260924 12:56:21.032074 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:56:21.033143 11461 external_mini_cluster.cc:1428] Setting key 1a9e7044a62d51c5bbc4c8be59c6a5ce
I20260924 12:56:21.044814 25396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Bootstrap starting.
I20260924 12:56:21.049332 25396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Neither blocks nor log segments found. Creating new log.
Sep 24 12:56:21 dist-test-slave-m9hg krb5kdc[25316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:21.050897 25396 log.cc:824] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:21.055639 25396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: No bootstrap required, opened a new log
I20260924 12:56:21.060930 25399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:21.036481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49130 (local address 127.11.49.126:38385)
0924 12:56:21.037599 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:21.037617 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:21.037724 (+ 107us) server_negotiation.cc:407] Connection header received
0924 12:56:21.039806 (+ 2082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:21.039838 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:21.040480 (+ 642us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:21.041008 (+ 528us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:21.042621 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:21.044069 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:21.045648 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:21.046421 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:21.046660 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:21.051172 (+ 4512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:21.051184 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:21.051215 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:21.051271 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:21.055594 (+ 4323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:21.056597 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:21.056611 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:21.056618 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:21.056834 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:21.057292 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:21.057296 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:21.057298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:21.057965 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:21.058391 (+ 426us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:21.058920 (+ 529us) server_negotiation.cc:299] Negotiation successful
0924 12:56:21.059562 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":813,"thread_start_us":497,"threads_started":1}
I20260924 12:56:21.066824 25396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:21.067413 25396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:21.067539 25396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6012d4b525534aa1abbbfa2dbdb939f5, State: Initialized, Role: FOLLOWER
I20260924 12:56:21.068490 25396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:21.069171 25396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:56:21.069380 25396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:56:21.069657 25396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:21.072625 25396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:21.073401 25396 leader_election.cc:302] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6012d4b525534aa1abbbfa2dbdb939f5; no voters:
I20260924 12:56:21.074131 25396 leader_election.cc:288] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:56:21.074368 25401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:56:21.076031 25401 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 1 LEADER]: Becoming Leader. State: Replica: 6012d4b525534aa1abbbfa2dbdb939f5, State: Running, Role: LEADER
I20260924 12:56:21.076965 25401 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:21.077716 25396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:56:21.080262 25403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6012d4b525534aa1abbbfa2dbdb939f5. Latest consensus state: current_term: 1 leader_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } } }
I20260924 12:56:21.080228 25402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } } }
I20260924 12:56:21.081007 25403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:21.081061 25402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:21.082759 25407 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:56:21.092422 25407 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:56:21.106989 25407 catalog_manager.cc:1347] Generated new cluster ID: c63c524fff9f4835b296fc4c6590672d
I20260924 12:56:21.107152 25407 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:56:21.140902 25407 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:56:21.142649 25407 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:56:21.155119 25407 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Generated new TSK 0
I20260924 12:56:21.156482 25407 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:56:21.233518 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38385
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:21.695833 25422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:21.696329 25422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:21.696555 25422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:21.706037 25422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:21.706243 25422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:21.706382 25422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:56:21.718739 25422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:21.720654 25422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:21.722685 25422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:21.743609 25428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:21.743618 25430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:21.743575 25427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:21.744843 25422 server_base.cc:1034] running on GCE node
I20260924 12:56:21.745589 25422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:21.746846 25422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:21.748214 25422 hybrid_clock.cc:648] HybridClock initialized: now 1790254581748137 us; error 64 us; skew 500 ppm
I20260924 12:56:21.748891 25422 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:21 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254581, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:21.753041 25422 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:56:21.755059 25422 webserver.cc:460] Webserver started at http://127.11.49.65:42595/ using document root <none> and password file <none>
I20260924 12:56:21.755931 25422 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:21.756059 25422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:21.756453 25422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:21.760037 25422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "bb22e217ceb249f0a25bebf9fda97398"
format_stamp: "Formatted at 2026-09-24 12:56:21 on dist-test-slave-m9hg"
server_key: "84a9cbddb314f1484a90702941bbb829"
server_key_iv: "4c41207973fb44a74bce49d83111383f"
server_key_version: "encryptionkey@0"
I20260924 12:56:21.761477 25422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "bb22e217ceb249f0a25bebf9fda97398"
format_stamp: "Formatted at 2026-09-24 12:56:21 on dist-test-slave-m9hg"
server_key: "84a9cbddb314f1484a90702941bbb829"
server_key_iv: "4c41207973fb44a74bce49d83111383f"
server_key_version: "encryptionkey@0"
I20260924 12:56:21.767761 25422 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260924 12:56:21.772828 25437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:21.775166 25422 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260924 12:56:21.775359 25422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "bb22e217ceb249f0a25bebf9fda97398"
format_stamp: "Formatted at 2026-09-24 12:56:21 on dist-test-slave-m9hg"
server_key: "84a9cbddb314f1484a90702941bbb829"
server_key_iv: "4c41207973fb44a74bce49d83111383f"
server_key_version: "encryptionkey@0"
I20260924 12:56:21.775664 25422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:21.804091 25422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:21.809499 25422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:21.809854 25422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:21.811157 25422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:21.812952 25422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:21.813041 25422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:21.813184 25422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:21.813257 25422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:21.857506 25422 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:33431
I20260924 12:56:21.857692 25549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:33431 every 8 connection(s)
I20260924 12:56:21.859004 25422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:56:21.861303 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 25422
I20260924 12:56:21.861635 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:56:21.862676 11461 external_mini_cluster.cc:1428] Setting key ae83e1f7993edb6260ba5a036b919203
Sep 24 12:56:21 dist-test-slave-m9hg krb5kdc[25316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254581, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:21.895248 25552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:21.863601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:42985 (local address 127.11.49.126:38385)
0924 12:56:21.864770 (+ 1169us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:21.864779 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:21.865664 (+ 885us) server_negotiation.cc:407] Connection header received
0924 12:56:21.869551 (+ 3887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:21.869558 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:21.869720 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:21.869965 (+ 245us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:21.873247 (+ 3282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:21.874099 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:21.877474 (+ 3375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:21.878181 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:21.878431 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:21.884514 (+ 6083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:21.884528 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:21.884543 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:21.884631 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:21.889473 (+ 4842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:21.891141 (+ 1668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:21.891151 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:21.891157 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:21.891394 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:21.892586 (+ 1192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:21.892595 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:21.892602 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:21.893098 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:21.893327 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:21.894481 (+ 1154us) server_negotiation.cc:299] Negotiation successful
0924 12:56:21.894785 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":995,"thread_start_us":858,"threads_started":1}
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:56:21.897475 25553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:21.864161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:42985)
0924 12:56:21.865439 (+ 1278us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:21.865536 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:21.868984 (+ 3448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:21.870410 (+ 1426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:21.870430 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:21.871560 (+ 1130us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:21.872849 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:21.872891 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:21.874355 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:21.874364 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:21.877086 (+ 2722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:21.877120 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:21.878622 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:21.878629 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:21.878960 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:21.880205 (+ 1245us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:21.880239 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:21.883706 (+ 3467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:21.889907 (+ 6201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:21.889921 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:21.889946 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:21.890880 (+ 934us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:21.891647 (+ 767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:21.891700 (+ 53us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:21.891707 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:21.892374 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:21.893316 (+ 942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:21.893325 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:21.893916 (+ 591us) client_negotiation.cc:769] Sending connection context
0924 12:56:21.894271 (+ 355us) client_negotiation.cc:240] Negotiation successful
0924 12:56:21.895048 (+ 777us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":846,"thread_start_us":484,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
I20260924 12:56:21.900158 25550 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38385
I20260924 12:56:21.900676 25550 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:21.901587 25550 heartbeater.cc:511] Master 127.11.49.126:38385 requested a full tablet report, sending...
I20260924 12:56:21.905180 25361 ts_manager.cc:194] Registered new tserver with Master: bb22e217ceb249f0a25bebf9fda97398 (127.11.49.65:33431)
I20260924 12:56:21.907255 25361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:42985
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:56:21.936185 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38385
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:22.371982 25556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:22.372465 25556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:22.372707 25556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:22.381811 25556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:22.381996 25556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:22.382202 25556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:56:22.394207 25556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:22.396466 25556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:22.398402 25556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:22.417336 25564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:22.417450 25561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:22.417434 25562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:22.419107 25556 server_base.cc:1034] running on GCE node
I20260924 12:56:22.420033 25556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:22.421506 25556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:22.422825 25556 hybrid_clock.cc:648] HybridClock initialized: now 1790254582422747 us; error 58 us; skew 500 ppm
I20260924 12:56:22.423326 25556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:22 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254582, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:22.427975 25556 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:56:22.430315 25556 webserver.cc:460] Webserver started at http://127.11.49.66:35633/ using document root <none> and password file <none>
I20260924 12:56:22.431313 25556 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:22.431499 25556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:22.431880 25556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:22.435886 25556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "c64c282d32644001b39468838530668e"
format_stamp: "Formatted at 2026-09-24 12:56:22 on dist-test-slave-m9hg"
server_key: "82164b257203e4f906a2bf1a7ff6c69b"
server_key_iv: "57de4ef0fee3173f1a8333c348b7e11a"
server_key_version: "encryptionkey@0"
I20260924 12:56:22.437135 25556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "c64c282d32644001b39468838530668e"
format_stamp: "Formatted at 2026-09-24 12:56:22 on dist-test-slave-m9hg"
server_key: "82164b257203e4f906a2bf1a7ff6c69b"
server_key_iv: "57de4ef0fee3173f1a8333c348b7e11a"
server_key_version: "encryptionkey@0"
I20260924 12:56:22.444640 25556 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260924 12:56:22.450451 25571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:22.452910 25556 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.007s sys 0.000s
I20260924 12:56:22.453275 25556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "c64c282d32644001b39468838530668e"
format_stamp: "Formatted at 2026-09-24 12:56:22 on dist-test-slave-m9hg"
server_key: "82164b257203e4f906a2bf1a7ff6c69b"
server_key_iv: "57de4ef0fee3173f1a8333c348b7e11a"
server_key_version: "encryptionkey@0"
I20260924 12:56:22.453650 25556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:22.484917 25556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:22.491443 25556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:22.491842 25556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:22.493446 25556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:22.495450 25556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:22.495585 25556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:22.495790 25556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:22.495875 25556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:22.540763 25556 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:34343
I20260924 12:56:22.540830 25683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:34343 every 8 connection(s)
I20260924 12:56:22.542315 25556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:56:22.549889 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 25556
I20260924 12:56:22.550149 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:56:22.550819 11461 external_mini_cluster.cc:1428] Setting key a83c610f5829ced32c88953055dcecb1
Sep 24 12:56:22 dist-test-slave-m9hg krb5kdc[25316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254582, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:22.574218 25686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:22.546175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:51787 (local address 127.11.49.126:38385)
0924 12:56:22.546896 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:22.546903 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:22.548312 (+ 1409us) server_negotiation.cc:407] Connection header received
0924 12:56:22.551495 (+ 3183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:22.551501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:22.551644 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:22.551800 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:22.554615 (+ 2815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:22.555825 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:22.558043 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:22.558839 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:22.559045 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:22.564773 (+ 5728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:22.564780 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:22.564784 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:22.564831 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:22.569144 (+ 4313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:22.570464 (+ 1320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:22.570475 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:22.570483 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:22.570693 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:22.571326 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:22.571335 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:22.571343 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:22.571826 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:22.572035 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:22.573288 (+ 1253us) server_negotiation.cc:299] Negotiation successful
0924 12:56:22.573618 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":390,"threads_started":1}
I20260924 12:56:22.575222 25687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:22.546810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:51787)
0924 12:56:22.547934 (+ 1124us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:22.548010 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:22.550917 (+ 2907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:22.552212 (+ 1295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:22.552227 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:22.553300 (+ 1073us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:22.554339 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:22.554368 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:22.556114 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:22.556121 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:22.557813 (+ 1692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:22.557833 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:22.559299 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:22.559310 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:22.559748 (+ 438us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:22.560958 (+ 1210us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:22.560992 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:22.564369 (+ 3377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:22.569445 (+ 5076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:22.569458 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:22.569481 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:22.570229 (+ 748us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:22.570853 (+ 624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:22.570857 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:22.570860 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:22.571158 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:22.572082 (+ 924us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:22.572091 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:22.572746 (+ 655us) client_negotiation.cc:769] Sending connection context
0924 12:56:22.573087 (+ 341us) client_negotiation.cc:240] Negotiation successful
0924 12:56:22.573676 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":364,"threads_started":1}
I20260924 12:56:22.577525 25684 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38385
I20260924 12:56:22.577986 25684 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:22.579101 25684 heartbeater.cc:511] Master 127.11.49.126:38385 requested a full tablet report, sending...
I20260924 12:56:22.581631 25361 ts_manager.cc:194] Registered new tserver with Master: c64c282d32644001b39468838530668e (127.11.49.66:34343)
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
I20260924 12:56:22.582804 25361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:51787
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:56:22.621265 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38385
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:56:22.911940 25550 heartbeater.cc:503] Master 127.11.49.126:38385 was elected leader, sending a full tablet report...
W20260924 12:56:23.061280 25690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:23.061748 25690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:23.061975 25690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:23.070681 25690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:23.070923 25690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:23.071141 25690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:56:23.083495 25690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:23.085436 25690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:23.087222 25690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:23.105314 25696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:23.105618 25695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:23.105592 25698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:23.110785 25690 server_base.cc:1034] running on GCE node
I20260924 12:56:23.111719 25690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:23.113250 25690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:23.114568 25690 hybrid_clock.cc:648] HybridClock initialized: now 1790254583114489 us; error 64 us; skew 500 ppm
I20260924 12:56:23.115077 25690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:23 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254583, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:23.119813 25690 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:56:23.122341 25690 webserver.cc:460] Webserver started at http://127.11.49.67:40285/ using document root <none> and password file <none>
I20260924 12:56:23.123391 25690 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:23.123580 25690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:23.124008 25690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:23.128257 25690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "fab59d7418c84dd5904ac40b6d3d7b8a"
format_stamp: "Formatted at 2026-09-24 12:56:23 on dist-test-slave-m9hg"
server_key: "dc6346b6d70726e18d2fffd6f0837534"
server_key_iv: "55ffea12c8dd1f9126f582a87ffc1352"
server_key_version: "encryptionkey@0"
I20260924 12:56:23.129562 25690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "fab59d7418c84dd5904ac40b6d3d7b8a"
format_stamp: "Formatted at 2026-09-24 12:56:23 on dist-test-slave-m9hg"
server_key: "dc6346b6d70726e18d2fffd6f0837534"
server_key_iv: "55ffea12c8dd1f9126f582a87ffc1352"
server_key_version: "encryptionkey@0"
I20260924 12:56:23.136778 25690 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260924 12:56:23.141791 25705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:23.144387 25690 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.001s
I20260924 12:56:23.144742 25690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "fab59d7418c84dd5904ac40b6d3d7b8a"
format_stamp: "Formatted at 2026-09-24 12:56:23 on dist-test-slave-m9hg"
server_key: "dc6346b6d70726e18d2fffd6f0837534"
server_key_iv: "55ffea12c8dd1f9126f582a87ffc1352"
server_key_version: "encryptionkey@0"
I20260924 12:56:23.145211 25690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:23.160602 25690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:23.166369 25690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:23.166808 25690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:23.168182 25690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:23.170212 25690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:23.170308 25690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:23.170464 25690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:23.170527 25690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:23.212600 25690 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:42145
I20260924 12:56:23.212652 25817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:42145 every 8 connection(s)
I20260924 12:56:23.214346 25690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:56:23.223414 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 25690
I20260924 12:56:23.223578 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:56:23.224287 11461 external_mini_cluster.cc:1428] Setting key f6496c9cfd2d0ccba705d5fcdaa95f1e
Sep 24 12:56:23 dist-test-slave-m9hg krb5kdc[25316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254583, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:23.242391 25820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.217548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:44555 (local address 127.11.49.126:38385)
0924 12:56:23.218231 (+ 683us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:23.218240 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:23.218986 (+ 746us) server_negotiation.cc:407] Connection header received
0924 12:56:23.221360 (+ 2374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:23.221366 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:23.221496 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:23.221651 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:23.223829 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.225041 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.227815 (+ 2774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.228461 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.228642 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.233859 (+ 5217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:23.233867 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:23.233871 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:23.233924 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:23.237541 (+ 3617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:23.238903 (+ 1362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:23.238910 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:23.238914 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:23.239112 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:23.239904 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:23.239912 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:23.239914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:23.240264 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:23.240515 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:23.241735 (+ 1220us) server_negotiation.cc:299] Negotiation successful
0924 12:56:23.242033 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":335,"threads_started":1}
I20260924 12:56:23.243896 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.217841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:44555)
0924 12:56:23.218762 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:23.218822 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:23.220985 (+ 2163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:23.221972 (+ 987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:23.221982 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:23.222676 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:23.223447 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.223468 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.225271 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.225279 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.227590 (+ 2311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.227627 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.228814 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.228822 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.229123 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.229965 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:23.229996 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:23.233451 (+ 3455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:23.237844 (+ 4393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:23.237856 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:23.237878 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:23.238663 (+ 785us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:23.239358 (+ 695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:23.239364 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:23.239367 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:23.239750 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:23.240535 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:23.240546 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:23.241199 (+ 653us) client_negotiation.cc:769] Sending connection context
0924 12:56:23.241617 (+ 418us) client_negotiation.cc:240] Negotiation successful
0924 12:56:23.242456 (+ 839us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":369,"threads_started":1}
I20260924 12:56:23.245858 25818 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38385
I20260924 12:56:23.246176 25818 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:23.246982 25818 heartbeater.cc:511] Master 127.11.49.126:38385 requested a full tablet report, sending...
I20260924 12:56:23.248795 25361 ts_manager.cc:194] Registered new tserver with Master: fab59d7418c84dd5904ac40b6d3d7b8a (127.11.49.67:42145)
I20260924 12:56:23.249645 25361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:44555
I20260924 12:56:23.255822 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:56:23.277881 25820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.261674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49146 (local address 127.11.49.126:38385)
0924 12:56:23.261925 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:23.261930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:23.262599 (+ 669us) server_negotiation.cc:407] Connection header received
0924 12:56:23.262783 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:23.262787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:23.262914 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:23.263035 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:23.264766 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.265604 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.267142 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.267548 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.267665 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.271112 (+ 3447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:23.271118 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:23.271121 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:23.271165 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:23.274351 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:23.275580 (+ 1229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:23.275585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:23.275587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:23.275747 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:23.276263 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:23.276297 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:23.276299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:23.276644 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:23.276881 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:23.277227 (+ 346us) server_negotiation.cc:299] Negotiation successful
0924 12:56:23.277452 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260924 12:56:23.283494 25361 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:56:23.290970 25361 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:56:23.325948 25832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.309663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50502 (local address 127.11.49.65:33431)
0924 12:56:23.310680 (+ 1017us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:23.310692 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:23.310736 (+ 44us) server_negotiation.cc:407] Connection header received
0924 12:56:23.311155 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:23.311166 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:23.311523 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:23.311793 (+ 270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:23.313655 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.316314 (+ 2659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.321802 (+ 5488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.323811 (+ 2009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.324013 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.324369 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:23.325275 (+ 906us) server_negotiation.cc:299] Negotiation successful
0924 12:56:23.325544 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":466,"threads_started":1}
I20260924 12:56:23.326253 25833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.310994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:34343 (local address 127.0.0.1:41054)
0924 12:56:23.311611 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:23.311637 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:23.311795 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:23.313510 (+ 1715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:23.313520 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:23.313563 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:23.314303 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.314321 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.317666 (+ 3345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.317677 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.321675 (+ 3998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.321720 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.324551 (+ 2831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.324558 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.325014 (+ 456us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.325074 (+ 60us) client_negotiation.cc:769] Sending connection context
0924 12:56:23.325209 (+ 135us) client_negotiation.cc:240] Negotiation successful
0924 12:56:23.325662 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":197,"thread_start_us":317,"threads_started":1}
I20260924 12:56:23.326790 25834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.311381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41054 (local address 127.11.49.66:34343)
0924 12:56:23.312532 (+ 1151us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:23.312546 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:23.312582 (+ 36us) server_negotiation.cc:407] Connection header received
0924 12:56:23.312744 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:23.312756 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:23.313163 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:23.314626 (+ 1463us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:23.315019 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.317376 (+ 2357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.322041 (+ 4665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.323811 (+ 1770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.324013 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.324317 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:23.325549 (+ 1232us) server_negotiation.cc:299] Negotiation successful
0924 12:56:23.325808 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":928,"thread_start_us":682,"threads_started":1}
I20260924 12:56:23.327427 25831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.309250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33431 (local address 127.0.0.1:50502)
0924 12:56:23.310388 (+ 1138us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:23.310450 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:23.310747 (+ 297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:23.312218 (+ 1471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:23.312227 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:23.312266 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:23.312788 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.312808 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.316595 (+ 3787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.316606 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.321419 (+ 4813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.321446 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.324500 (+ 3054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.324508 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.324873 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.324964 (+ 91us) client_negotiation.cc:769] Sending connection context
0924 12:56:23.325181 (+ 217us) client_negotiation.cc:240] Negotiation successful
0924 12:56:23.326892 (+ 1711us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":2632,"thread_start_us":403,"threads_started":1}
I20260924 12:56:23.330976 25836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.312568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:42145 (local address 127.0.0.1:54304)
0924 12:56:23.319185 (+ 6617us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:23.319213 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:23.319408 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:23.321900 (+ 2492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:23.321905 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:23.321941 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:23.322369 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.322380 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.324715 (+ 2335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.324720 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.327379 (+ 2659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.327419 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.329865 (+ 2446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.329873 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.330117 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.330180 (+ 63us) client_negotiation.cc:769] Sending connection context
0924 12:56:23.330324 (+ 144us) client_negotiation.cc:240] Negotiation successful
0924 12:56:23.330514 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6430,"mutex_wait_us":28,"thread_start_us":6179,"threads_started":1}
I20260924 12:56:23.331066 25835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.312223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54304 (local address 127.11.49.67:42145)
0924 12:56:23.321088 (+ 8865us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:23.321099 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:23.321142 (+ 43us) server_negotiation.cc:407] Connection header received
0924 12:56:23.321289 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:23.321300 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:23.321645 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:23.321917 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:23.322650 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.324531 (+ 1881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.327693 (+ 3162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.329449 (+ 1756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.329637 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.329937 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:23.330411 (+ 474us) server_negotiation.cc:299] Negotiation successful
0924 12:56:23.330643 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8625,"thread_start_us":8406,"threads_started":1}
I20260924 12:56:23.332506 25619 tablet_service.cc:1467] Processing CreateTablet for tablet 45c7b6cc0a0040028035f005dc55e7eb (DEFAULT_TABLE table=test-table [id=eadec83e8d1b49509baf665ac53c3509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:23.332861 25485 tablet_service.cc:1467] Processing CreateTablet for tablet 45c7b6cc0a0040028035f005dc55e7eb (DEFAULT_TABLE table=test-table [id=eadec83e8d1b49509baf665ac53c3509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:23.334410 25619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45c7b6cc0a0040028035f005dc55e7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:23.334750 25485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45c7b6cc0a0040028035f005dc55e7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:23.336489 25753 tablet_service.cc:1467] Processing CreateTablet for tablet 45c7b6cc0a0040028035f005dc55e7eb (DEFAULT_TABLE table=test-table [id=eadec83e8d1b49509baf665ac53c3509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:23.338904 25753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45c7b6cc0a0040028035f005dc55e7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:23.350967 25837 tablet_bootstrap.cc:492] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: Bootstrap starting.
I20260924 12:56:23.356084 25838 tablet_bootstrap.cc:492] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: Bootstrap starting.
I20260924 12:56:23.358403 25837 tablet_bootstrap.cc:654] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:23.359510 25839 tablet_bootstrap.cc:492] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: Bootstrap starting.
I20260924 12:56:23.361017 25837 log.cc:824] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:23.362134 25838 tablet_bootstrap.cc:654] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:23.363472 25839 tablet_bootstrap.cc:654] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:23.364738 25838 log.cc:824] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:23.364898 25839 log.cc:824] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:23.365260 25837 tablet_bootstrap.cc:492] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: No bootstrap required, opened a new log
I20260924 12:56:23.365644 25837 ts_tablet_manager.cc:1397] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20260924 12:56:23.369252 25839 tablet_bootstrap.cc:492] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: No bootstrap required, opened a new log
I20260924 12:56:23.369587 25839 ts_tablet_manager.cc:1397] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260924 12:56:23.370371 25838 tablet_bootstrap.cc:492] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: No bootstrap required, opened a new log
I20260924 12:56:23.370782 25838 ts_tablet_manager.cc:1397] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260924 12:56:23.377120 25837 raft_consensus.cc:348] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:23.377672 25837 raft_consensus.cc:374] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:23.377918 25837 raft_consensus.cc:729] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c64c282d32644001b39468838530668e, State: Initialized, Role: FOLLOWER
I20260924 12:56:23.378669 25837 consensus_queue.cc:260] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:23.380501 25684 heartbeater.cc:503] Master 127.11.49.126:38385 was elected leader, sending a full tablet report...
I20260924 12:56:23.381071 25837 ts_tablet_manager.cc:1428] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260924 12:56:23.381309 25839 raft_consensus.cc:348] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:23.381752 25839 raft_consensus.cc:374] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:23.381843 25839 raft_consensus.cc:729] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab59d7418c84dd5904ac40b6d3d7b8a, State: Initialized, Role: FOLLOWER
I20260924 12:56:23.382445 25839 consensus_queue.cc:260] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:23.382963 25838 raft_consensus.cc:348] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:23.383678 25838 raft_consensus.cc:374] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:23.383751 25818 heartbeater.cc:503] Master 127.11.49.126:38385 was elected leader, sending a full tablet report...
I20260924 12:56:23.383805 25838 raft_consensus.cc:729] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb22e217ceb249f0a25bebf9fda97398, State: Initialized, Role: FOLLOWER
I20260924 12:56:23.384655 25838 consensus_queue.cc:260] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:23.385936 25839 ts_tablet_manager.cc:1428] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260924 12:56:23.393997 25838 ts_tablet_manager.cc:1428] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: Time spent starting tablet: real 0.023s user 0.017s sys 0.004s
W20260924 12:56:23.466526 25819 tablet.cc:2369] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:56:23.545337 25685 tablet.cc:2369] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:56:23.569362 25845 raft_consensus.cc:482] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:56:23.569818 25845 raft_consensus.cc:504] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:23.571992 25845 leader_election.cc:288] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c64c282d32644001b39468838530668e (127.11.49.66:34343), fab59d7418c84dd5904ac40b6d3d7b8a (127.11.49.67:42145)
I20260924 12:56:23.580070 25834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.572718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:44377 (local address 127.11.49.66:34343)
0924 12:56:23.572980 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:23.572986 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:23.573539 (+ 553us) server_negotiation.cc:407] Connection header received
0924 12:56:23.573870 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:23.573879 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:23.573969 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:23.574041 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:23.575006 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.575772 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.577966 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.578980 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.579207 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.579309 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:23.579655 (+ 346us) server_negotiation.cc:299] Negotiation successful
0924 12:56:23.579787 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260924 12:56:23.580252 25846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.572534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:34343 (local address 127.11.49.65:44377)
0924 12:56:23.573397 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:23.573420 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:23.573589 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:23.574233 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:23.574236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:23.574265 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:23.574837 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.574849 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.575924 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.575930 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.577771 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.577785 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.579252 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.579258 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.579425 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.579451 (+ 26us) client_negotiation.cc:769] Sending connection context
0924 12:56:23.579604 (+ 153us) client_negotiation.cc:240] Negotiation successful
0924 12:56:23.579763 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"mutex_wait_us":37,"thread_start_us":447,"threads_started":1}
I20260924 12:56:23.581308 25835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.573957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:59641 (local address 127.11.49.67:42145)
0924 12:56:23.574202 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:23.574209 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:23.574613 (+ 404us) server_negotiation.cc:407] Connection header received
0924 12:56:23.574907 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:23.574911 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:23.574979 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:23.575082 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:23.575719 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.576659 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.578799 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.579877 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.580087 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.580192 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:23.580702 (+ 510us) server_negotiation.cc:299] Negotiation successful
0924 12:56:23.580870 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260924 12:56:23.581481 25847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.573505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:42145 (local address 127.11.49.65:59641)
0924 12:56:23.574459 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:23.574479 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:23.574719 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:23.575145 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:23.575150 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:23.575176 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:23.575543 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.575552 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.576817 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.576823 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.578512 (+ 1689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:23.578558 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.580184 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.580256 (+ 72us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:23.580500 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.580537 (+ 37us) client_negotiation.cc:769] Sending connection context
0924 12:56:23.580653 (+ 116us) client_negotiation.cc:240] Negotiation successful
0924 12:56:23.580870 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":4,"thread_start_us":334,"threads_started":1}
I20260924 12:56:23.581353 25639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45c7b6cc0a0040028035f005dc55e7eb" candidate_uuid: "bb22e217ceb249f0a25bebf9fda97398" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c64c282d32644001b39468838530668e" is_pre_election: true
I20260924 12:56:23.582010 25639 raft_consensus.cc:2454] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb22e217ceb249f0a25bebf9fda97398 in term 0.
I20260924 12:56:23.582875 25773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45c7b6cc0a0040028035f005dc55e7eb" candidate_uuid: "bb22e217ceb249f0a25bebf9fda97398" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" is_pre_election: true
I20260924 12:56:23.583639 25773 raft_consensus.cc:2454] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb22e217ceb249f0a25bebf9fda97398 in term 0.
I20260924 12:56:23.584885 25438 leader_election.cc:302] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb22e217ceb249f0a25bebf9fda97398, fab59d7418c84dd5904ac40b6d3d7b8a; no voters:
I20260924 12:56:23.585412 25845 raft_consensus.cc:2781] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:56:23.585592 25845 raft_consensus.cc:482] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:56:23.585714 25845 raft_consensus.cc:3037] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:23.589366 25845 raft_consensus.cc:504] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:23.590471 25845 leader_election.cc:288] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [CANDIDATE]: Term 1 election: Requested vote from peers c64c282d32644001b39468838530668e (127.11.49.66:34343), fab59d7418c84dd5904ac40b6d3d7b8a (127.11.49.67:42145)
I20260924 12:56:23.591163 25639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45c7b6cc0a0040028035f005dc55e7eb" candidate_uuid: "bb22e217ceb249f0a25bebf9fda97398" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c64c282d32644001b39468838530668e"
I20260924 12:56:23.591456 25639 raft_consensus.cc:3037] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:23.591776 25773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45c7b6cc0a0040028035f005dc55e7eb" candidate_uuid: "bb22e217ceb249f0a25bebf9fda97398" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a"
I20260924 12:56:23.592105 25773 raft_consensus.cc:3037] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:23.594853 25639 raft_consensus.cc:2454] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb22e217ceb249f0a25bebf9fda97398 in term 1.
I20260924 12:56:23.595486 25438 leader_election.cc:302] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb22e217ceb249f0a25bebf9fda97398, c64c282d32644001b39468838530668e; no voters:
I20260924 12:56:23.596025 25845 raft_consensus.cc:2781] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:56:23.596606 25773 raft_consensus.cc:2454] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb22e217ceb249f0a25bebf9fda97398 in term 1.
I20260924 12:56:23.596725 25845 raft_consensus.cc:686] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 1 LEADER]: Becoming Leader. State: Replica: bb22e217ceb249f0a25bebf9fda97398, State: Running, Role: LEADER
I20260924 12:56:23.597486 25845 consensus_queue.cc:237] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:23.604218 25361 catalog_manager.cc:5495] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb22e217ceb249f0a25bebf9fda97398 (127.11.49.65). New cstate: current_term: 1 leader_uuid: "bb22e217ceb249f0a25bebf9fda97398" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } health_report { overall_health: UNKNOWN } } }
W20260924 12:56:23.612840 25551 tablet.cc:2369] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:56:23.640494 25832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.634182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50504 (local address 127.11.49.65:33431)
0924 12:56:23.634394 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:23.634399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:23.634420 (+ 21us) server_negotiation.cc:407] Connection header received
0924 12:56:23.634519 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:23.634522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:23.634623 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:23.634772 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:56:23.635245 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.636016 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.637903 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.638339 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.638445 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.639180 (+ 735us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:56:23.639798 (+ 618us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:56:23.639947 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:23.640148 (+ 201us) server_negotiation.cc:299] Negotiation successful
0924 12:56:23.640227 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260924 12:56:23.650964 25773 raft_consensus.cc:1261] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a [term 1 FOLLOWER]: Refusing update from remote peer bb22e217ceb249f0a25bebf9fda97398: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:56:23.651376 25639 raft_consensus.cc:1261] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e [term 1 FOLLOWER]: Refusing update from remote peer bb22e217ceb249f0a25bebf9fda97398: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:56:23.652370 25848 consensus_queue.cc:1035] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:56:23.652896 25845 consensus_queue.cc:1035] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:56:23.667987 25851 mvcc.cc:205] Tried to move back new op lower bound from 7332882774620618752 to 7332882774420856832. Current Snapshot: MvccSnapshot[applied={T|T < 7332882774620618752}]
I20260924 12:56:23.687908 25359 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:56:23.688303 25359 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:56:23.693958 25359 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Sending DeleteTablet for 3 replicas of tablet 45c7b6cc0a0040028035f005dc55e7eb
I20260924 12:56:23.695712 25485 tablet_service.cc:1514] Processing DeleteTablet for tablet 45c7b6cc0a0040028035f005dc55e7eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:23 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:50502
I20260924 12:56:23.696012 25619 tablet_service.cc:1514] Processing DeleteTablet for tablet 45c7b6cc0a0040028035f005dc55e7eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:23 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:41054
I20260924 12:56:23.696127 25753 tablet_service.cc:1514] Processing DeleteTablet for tablet 45c7b6cc0a0040028035f005dc55e7eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:23 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:54304
I20260924 12:56:23.697592 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 25422
I20260924 12:56:23.711926 25861 tablet_replica.cc:330] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: stopping tablet replica
I20260924 12:56:23.712731 25861 raft_consensus.cc:2229] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:56:23.717923 25861 raft_consensus.cc:2258] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:23.719436 25862 tablet_replica.cc:330] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: stopping tablet replica
I20260924 12:56:23.720570 25862 raft_consensus.cc:2229] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:56:23.721617 25862 raft_consensus.cc:2258] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:23.722157 25861 ts_tablet_manager.cc:1905] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:23.722828 25863 tablet_replica.cc:330] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: stopping tablet replica
I20260924 12:56:23.723475 25863 raft_consensus.cc:2229] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:56:23.724332 25863 raft_consensus.cc:2258] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:23.725620 25862 ts_tablet_manager.cc:1905] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: Deleting tablet data with delete state TABLET_DATA_DELETED
Sep 24 12:56:23 dist-test-slave-m9hg krb5kdc[25316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:56:23.734954 25862 ts_tablet_manager.cc:1918] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:23.735335 25862 log.cc:1196] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/45c7b6cc0a0040028035f005dc55e7eb
I20260924 12:56:23.735708 25861 ts_tablet_manager.cc:1918] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:23.736004 25861 log.cc:1196] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/45c7b6cc0a0040028035f005dc55e7eb
I20260924 12:56:23.736109 25862 ts_tablet_manager.cc:1939] T 45c7b6cc0a0040028035f005dc55e7eb P fab59d7418c84dd5904ac40b6d3d7b8a: Deleting consensus metadata
I20260924 12:56:23.736819 25861 ts_tablet_manager.cc:1939] T 45c7b6cc0a0040028035f005dc55e7eb P bb22e217ceb249f0a25bebf9fda97398: Deleting consensus metadata
I20260924 12:56:23.738348 25863 ts_tablet_manager.cc:1905] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:23.739081 25345 catalog_manager.cc:4841] TS fab59d7418c84dd5904ac40b6d3d7b8a (127.11.49.67:42145): tablet 45c7b6cc0a0040028035f005dc55e7eb (table test-table [id=eadec83e8d1b49509baf665ac53c3509]) successfully deleted
I20260924 12:56:23.739934 25345 catalog_manager.cc:4841] TS bb22e217ceb249f0a25bebf9fda97398 (127.11.49.65:33431): tablet 45c7b6cc0a0040028035f005dc55e7eb (table test-table [id=eadec83e8d1b49509baf665ac53c3509]) successfully deleted
I20260924 12:56:23.740293 25832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.700089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50510 (local address 127.11.49.65:33431)
0924 12:56:23.700672 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:23.700680 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:23.706435 (+ 5755us) server_negotiation.cc:407] Connection header received
0924 12:56:23.707880 (+ 1445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:23.707887 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:23.708000 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:23.708093 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:23.713116 (+ 5023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.714519 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.718636 (+ 4117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.719511 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.719639 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.729333 (+ 9694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:23.729357 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:23.729380 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:23.729487 (+ 107us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:23.734874 (+ 5387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:23.737127 (+ 2253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:23.737139 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:23.737144 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:23.737415 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:23.737986 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:23.737992 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:23.737995 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:23.738564 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:23.738851 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:23.739538 (+ 687us) server_negotiation.cc:299] Negotiation successful
0924 12:56:23.739842 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402}
I20260924 12:56:23.742564 25545 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:23.746481 25863 ts_tablet_manager.cc:1918] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:23.746675 25863 log.cc:1196] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/45c7b6cc0a0040028035f005dc55e7eb
I20260924 12:56:23.747320 25863 ts_tablet_manager.cc:1939] T 45c7b6cc0a0040028035f005dc55e7eb P c64c282d32644001b39468838530668e: Deleting consensus metadata
I20260924 12:56:23.749541 25345 catalog_manager.cc:4841] TS c64c282d32644001b39468838530668e (127.11.49.66:34343): tablet 45c7b6cc0a0040028035f005dc55e7eb (table test-table [id=eadec83e8d1b49509baf665ac53c3509]) successfully deleted
I20260924 12:56:23.860060 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 25422
I20260924 12:56:23.882716 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 25556
Sep 24 12:56:23 dist-test-slave-m9hg krb5kdc[25316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:56:23.899355 25834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:23.883871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41058 (local address 127.11.49.66:34343)
0924 12:56:23.884101 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:23.884110 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:23.884133 (+ 23us) server_negotiation.cc:407] Connection header received
0924 12:56:23.884376 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:23.884382 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:23.884465 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:23.884600 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:23.885962 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.886715 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.888030 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:23.888503 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:23.888633 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:23.893092 (+ 4459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:23.893108 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:23.893124 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:23.893165 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:23.896240 (+ 3075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:23.897106 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:23.897122 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:23.897125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:23.897255 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:23.897662 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:23.897666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:23.897668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:23.898064 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:23.898362 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:23.898710 (+ 348us) server_negotiation.cc:299] Negotiation successful
0924 12:56:23.898953 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260924 12:56:23.900369 25679 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:24.004909 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 25556
I20260924 12:56:24.023823 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 25690
Sep 24 12:56:24 dist-test-slave-m9hg krb5kdc[25316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:56:24.051610 25835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:24.024806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54314 (local address 127.11.49.67:42145)
0924 12:56:24.025044 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:24.025050 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:24.025297 (+ 247us) server_negotiation.cc:407] Connection header received
0924 12:56:24.025504 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:24.025508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:24.025587 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:24.025687 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:24.027660 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:24.028665 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:24.030766 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:24.031199 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:24.031317 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:24.045086 (+ 13769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:24.045106 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:24.045122 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:24.045167 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:24.048199 (+ 3032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:24.049088 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:24.049103 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:24.049105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:24.049277 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:24.049684 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:24.049695 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:24.049697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:24.050186 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:24.050506 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:24.050838 (+ 332us) server_negotiation.cc:299] Negotiation successful
0924 12:56:24.051066 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260924 12:56:24.052587 25813 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:24.157579 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 25690
I20260924 12:56:24.178447 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 25329
I20260924 12:56:24.179724 25391 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:24.310652 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 25329
I20260924 12:56:24.334986 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38385
--webserver_interface=127.11.49.126
--webserver_port=36037
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:38385
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:24.699229 25869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:24.699571 25869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:24.699666 25869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:24.707453 25869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:56:24.707599 25869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:24.707649 25869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:24.707703 25869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:56:24.707739 25869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:56:24.718117 25869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:38385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=36037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:24.719553 25869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:24.720944 25869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:24.749826 25876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:24.749795 25875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:24.750368 25878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:24.751093 25869 server_base.cc:1034] running on GCE node
I20260924 12:56:24.752463 25869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:24.754949 25869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:24.756395 25869 hybrid_clock.cc:648] HybridClock initialized: now 1790254584756210 us; error 75 us; skew 500 ppm
I20260924 12:56:24.757040 25869 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:24 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254584, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:24.762285 25869 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:56:24.764705 25869 webserver.cc:460] Webserver started at http://127.11.49.126:36037/ using document root <none> and password file <none>
I20260924 12:56:24.765678 25869 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:24.765836 25869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:24.773661 25869 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.002s
I20260924 12:56:24.778162 25885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:24.780452 25869 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.001s
I20260924 12:56:24.780680 25869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "6012d4b525534aa1abbbfa2dbdb939f5"
format_stamp: "Formatted at 2026-09-24 12:56:20 on dist-test-slave-m9hg"
server_key: "30b45a6e8c077bef91eee29473ec8fe4"
server_key_iv: "7fcb5c7f9ff8ddf31c548623d02c6f63"
server_key_version: "encryptionkey@0"
I20260924 12:56:24.781910 25869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:24.809312 25869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:24.814327 25869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:24.814585 25869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:24.838020 25869 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:38385
I20260924 12:56:24.838039 25936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:38385 every 8 connection(s)
I20260924 12:56:24.839735 25869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:56:24.847235 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 25869
I20260924 12:56:24.848109 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:33431
--local_ip_for_outbound_sockets=127.11.49.65
--tserver_master_addrs=127.11.49.126:38385
--webserver_port=42595
--webserver_interface=127.11.49.65
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:56:24.849364 25937 sys_catalog.cc:263] Verifying existing consensus state
I20260924 12:56:24.854174 25937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Bootstrap starting.
I20260924 12:56:24.891993 25937 log.cc:824] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:24.912881 25937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 12:56:24.913740 25937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Bootstrap complete.
I20260924 12:56:24.931993 25937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:24.934305 25937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6012d4b525534aa1abbbfa2dbdb939f5, State: Initialized, Role: FOLLOWER
I20260924 12:56:24.936124 25937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:24.936789 25937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:56:24.937014 25937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:56:24.937417 25937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 1 FOLLOWER]: Advancing to term 2
I20260924 12:56:24.946004 25937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:24.947026 25937 leader_election.cc:302] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6012d4b525534aa1abbbfa2dbdb939f5; no voters:
I20260924 12:56:24.947960 25937 leader_election.cc:288] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260924 12:56:24.948253 25941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260924 12:56:24.949796 25941 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 2 LEADER]: Becoming Leader. State: Replica: 6012d4b525534aa1abbbfa2dbdb939f5, State: Running, Role: LEADER
I20260924 12:56:24.950562 25941 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:24.951076 25937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:56:24.953890 25942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } } }
I20260924 12:56:24.954351 25943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6012d4b525534aa1abbbfa2dbdb939f5. Latest consensus state: current_term: 2 leader_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } } }
I20260924 12:56:24.954754 25943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:24.954761 25942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:24.966114 25947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:56:24.984387 25947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:56:24.986624 25947 catalog_manager.cc:1259] Loaded cluster ID: c63c524fff9f4835b296fc4c6590672d
I20260924 12:56:24.986804 25947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:56:24.991446 25947 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260924 12:56:25.013137 25947 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260924 12:56:25.026357 25947 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:56:25.028898 25947 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Loaded TSK: 0
I20260924 12:56:25.031661 25947 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260924 12:56:25.357666 25939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:25.358089 25939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:25.358279 25939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:25.367801 25939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:25.368022 25939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:25.368249 25939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:56:25.380451 25939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:33431
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=42595
--tserver_master_addrs=127.11.49.126:38385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:25.382380 25939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:25.384460 25939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:25.402971 25964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:25.403059 25967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:25.403076 25965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:25.404817 25939 server_base.cc:1034] running on GCE node
I20260924 12:56:25.405979 25939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:25.407407 25939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:25.408752 25939 hybrid_clock.cc:648] HybridClock initialized: now 1790254585408706 us; error 86 us; skew 500 ppm
I20260924 12:56:25.409260 25939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:25 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254585, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:25.414031 25939 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:56:25.416646 25939 webserver.cc:460] Webserver started at http://127.11.49.65:42595/ using document root <none> and password file <none>
I20260924 12:56:25.417716 25939 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:25.417892 25939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:25.426694 25939 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260924 12:56:25.431253 25974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:25.433621 25939 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260924 12:56:25.433964 25939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "bb22e217ceb249f0a25bebf9fda97398"
format_stamp: "Formatted at 2026-09-24 12:56:21 on dist-test-slave-m9hg"
server_key: "84a9cbddb314f1484a90702941bbb829"
server_key_iv: "4c41207973fb44a74bce49d83111383f"
server_key_version: "encryptionkey@0"
I20260924 12:56:25.435461 25939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:25.453038 25939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:25.459074 25939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:25.459460 25939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:25.460922 25939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:25.462832 25939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:25.462962 25939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:25.463148 25939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:25.463240 25939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:25.506883 25939 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:33431
I20260924 12:56:25.506963 26086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:33431 every 8 connection(s)
I20260924 12:56:25.508898 25939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:56:25.517162 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 25939
I20260924 12:56:25.518160 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:34343
--local_ip_for_outbound_sockets=127.11.49.66
--tserver_master_addrs=127.11.49.126:38385
--webserver_port=35633
--webserver_interface=127.11.49.66
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:56:25 dist-test-slave-m9hg krb5kdc[25316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254585, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:25.545825 26089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:25.512721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:47119 (local address 127.11.49.126:38385)
0924 12:56:25.513414 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:25.513433 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:25.514193 (+ 760us) server_negotiation.cc:407] Connection header received
0924 12:56:25.516684 (+ 2491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:25.516696 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:25.517058 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:25.517451 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:25.520653 (+ 3202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:25.522164 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:25.525810 (+ 3646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:25.526546 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:25.526713 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:25.532675 (+ 5962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:25.532690 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:25.532718 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:25.532787 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:25.538259 (+ 5472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:25.539638 (+ 1379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:25.539652 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:25.539665 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:25.539959 (+ 294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:25.540977 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:25.540983 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:25.540985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:25.541877 (+ 892us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:25.542189 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:25.543537 (+ 1348us) server_negotiation.cc:299] Negotiation successful
0924 12:56:25.544057 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":300,"threads_started":1}
I20260924 12:56:25.545874 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:25.512992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:47119)
0924 12:56:25.513976 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:25.514029 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:25.516055 (+ 2026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:25.517873 (+ 1818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:25.517892 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:25.519036 (+ 1144us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:25.520264 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:25.520348 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:25.522465 (+ 2117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:25.522475 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:25.525506 (+ 3031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:25.525541 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:25.526907 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:25.526920 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:25.527360 (+ 440us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:25.528605 (+ 1245us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:25.528650 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:25.532130 (+ 3480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:25.538623 (+ 6493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:25.538636 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:25.538655 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:25.539378 (+ 723us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:25.540161 (+ 783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:25.540165 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:25.540169 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:25.540658 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:25.542084 (+ 1426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:25.542094 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:25.542849 (+ 755us) client_negotiation.cc:769] Sending connection context
0924 12:56:25.543219 (+ 370us) client_negotiation.cc:240] Negotiation successful
0924 12:56:25.544057 (+ 838us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":378,"threads_started":1}
I20260924 12:56:25.551390 26087 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38385
I20260924 12:56:25.551882 26087 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:25.552973 26087 heartbeater.cc:511] Master 127.11.49.126:38385 requested a full tablet report, sending...
I20260924 12:56:25.556074 25902 ts_manager.cc:194] Registered new tserver with Master: bb22e217ceb249f0a25bebf9fda97398 (127.11.49.65:33431)
I20260924 12:56:25.558519 25902 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:47119
W20260924 12:56:25.897415 26091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:25.897722 26091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:25.897821 26091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:25.905356 26091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:25.905500 26091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:25.905623 26091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:56:25.915689 26091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:34343
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=35633
--tserver_master_addrs=127.11.49.126:38385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:25.917037 26091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:25.918324 26091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:25.933190 26097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:25.933449 26096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:25.933248 26099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:25.935546 26091 server_base.cc:1034] running on GCE node
I20260924 12:56:25.936508 26091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:25.937711 26091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:25.939033 26091 hybrid_clock.cc:648] HybridClock initialized: now 1790254585938954 us; error 70 us; skew 500 ppm
I20260924 12:56:25.939507 26091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:25 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254585, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:25.945303 26091 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:56:25.947569 26091 webserver.cc:460] Webserver started at http://127.11.49.66:35633/ using document root <none> and password file <none>
I20260924 12:56:25.948613 26091 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:25.948817 26091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:25.956619 26091 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260924 12:56:25.961287 26106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:25.963523 26091 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260924 12:56:25.963832 26091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "c64c282d32644001b39468838530668e"
format_stamp: "Formatted at 2026-09-24 12:56:22 on dist-test-slave-m9hg"
server_key: "82164b257203e4f906a2bf1a7ff6c69b"
server_key_iv: "57de4ef0fee3173f1a8333c348b7e11a"
server_key_version: "encryptionkey@0"
I20260924 12:56:25.965613 26091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:25.991305 26091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:25.997720 26091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:25.998101 26091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:25.999506 26091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:26.001385 26091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:26.001552 26091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:26.001718 26091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:26.001829 26091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:26.048182 26091 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:34343
I20260924 12:56:26.048354 26218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:34343 every 8 connection(s)
I20260924 12:56:26.050186 26091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:56:26.058573 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 26091
I20260924 12:56:26.059340 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:42145
--local_ip_for_outbound_sockets=127.11.49.67
--tserver_master_addrs=127.11.49.126:38385
--webserver_port=40285
--webserver_interface=127.11.49.67
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:56:26 dist-test-slave-m9hg krb5kdc[25316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254585, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:26.082425 26221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.053689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:44043 (local address 127.11.49.126:38385)
0924 12:56:26.054277 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:26.054285 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:26.055486 (+ 1201us) server_negotiation.cc:407] Connection header received
0924 12:56:26.057980 (+ 2494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:26.057985 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:26.058119 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:26.058297 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:26.060649 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.061900 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.064396 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.065206 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.065414 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.071778 (+ 6364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:26.071790 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:26.071799 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:26.071901 (+ 102us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:26.077486 (+ 5585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:26.078792 (+ 1306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:26.078803 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:26.078809 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:26.079076 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:26.079660 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:26.079669 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:26.079675 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:26.080212 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:26.080510 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:26.081396 (+ 886us) server_negotiation.cc:299] Negotiation successful
0924 12:56:26.081763 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":266,"threads_started":1}
I20260924 12:56:26.082926 26222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.054295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:44043)
0924 12:56:26.055263 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:26.055320 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:26.057525 (+ 2205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:26.058581 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:26.058592 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:26.059393 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:26.060387 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.060414 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.062162 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.062168 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.064028 (+ 1860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.064076 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.065652 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.065661 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.066014 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.067149 (+ 1135us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:26.067189 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:26.071336 (+ 4147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:26.077825 (+ 6489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:26.077835 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:26.077852 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:26.078525 (+ 673us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:26.079259 (+ 734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:26.079263 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:26.079265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:26.079491 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:26.080465 (+ 974us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:26.080472 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:26.080903 (+ 431us) client_negotiation.cc:769] Sending connection context
0924 12:56:26.081167 (+ 264us) client_negotiation.cc:240] Negotiation successful
0924 12:56:26.081635 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":360,"threads_started":1}
I20260924 12:56:26.085009 26219 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38385
I20260924 12:56:26.085383 26219 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:26.086154 26219 heartbeater.cc:511] Master 127.11.49.126:38385 requested a full tablet report, sending...
I20260924 12:56:26.088079 25902 ts_manager.cc:194] Registered new tserver with Master: c64c282d32644001b39468838530668e (127.11.49.66:34343)
I20260924 12:56:26.089069 25902 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:44043
W20260924 12:56:26.509788 26223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:26.510187 26223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:26.510303 26223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:26.519500 26223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:26.519690 26223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:26.519937 26223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:56:26.532546 26223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:42145
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=40285
--tserver_master_addrs=127.11.49.126:38385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:26.534363 26223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:26.536870 26223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:26.557557 26231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:26.558203 26228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:26.558305 26229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:26.558805 26223 server_base.cc:1034] running on GCE node
I20260924 12:56:26.559731 26223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:26.561353 26223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:26.562705 26223 hybrid_clock.cc:648] HybridClock initialized: now 1790254586562652 us; error 60 us; skew 500 ppm
I20260924 12:56:26.563329 26223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:56:26.563673 26087 heartbeater.cc:503] Master 127.11.49.126:38385 was elected leader, sending a full tablet report...
Sep 24 12:56:26 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254586, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:26.568989 26223 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:56:26.571329 26223 webserver.cc:460] Webserver started at http://127.11.49.67:40285/ using document root <none> and password file <none>
I20260924 12:56:26.572655 26223 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:26.572903 26223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:26.581099 26223 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260924 12:56:26.585662 26238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:26.588106 26223 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260924 12:56:26.588394 26223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "fab59d7418c84dd5904ac40b6d3d7b8a"
format_stamp: "Formatted at 2026-09-24 12:56:23 on dist-test-slave-m9hg"
server_key: "dc6346b6d70726e18d2fffd6f0837534"
server_key_iv: "55ffea12c8dd1f9126f582a87ffc1352"
server_key_version: "encryptionkey@0"
I20260924 12:56:26.589566 26223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:26.631116 26223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:26.636067 26223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:26.636422 26223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:26.637619 26223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:26.639213 26223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:26.639317 26223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:26.639394 26223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:26.639462 26223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:26.682200 26223 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:42145
I20260924 12:56:26.682365 26350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:42145 every 8 connection(s)
I20260924 12:56:26.683950 26223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:56:26.687985 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 26223
Sep 24 12:56:26 dist-test-slave-m9hg krb5kdc[25316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254586, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:26.713217 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.689381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33608 (local address 127.11.49.126:38385)
0924 12:56:26.692868 (+ 3487us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:26.692873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:26.693575 (+ 702us) server_negotiation.cc:407] Connection header received
0924 12:56:26.693701 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:26.693706 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:26.693804 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:26.694119 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:26.696224 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.697545 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.699546 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.700480 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.700602 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.704393 (+ 3791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:26.704400 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:26.704404 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:26.704449 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:26.708671 (+ 4222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:26.710129 (+ 1458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:26.710136 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:26.710139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:26.710307 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:26.711095 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:26.711100 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:26.711103 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:26.711514 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:26.711837 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:26.712513 (+ 676us) server_negotiation.cc:299] Negotiation successful
0924 12:56:26.712812 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3315,"thread_start_us":3162,"threads_started":1}
I20260924 12:56:26.714623 26353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.687824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:35041 (local address 127.11.49.126:38385)
0924 12:56:26.688484 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:26.688489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:26.692152 (+ 3663us) server_negotiation.cc:407] Connection header received
0924 12:56:26.692229 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:26.692234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:26.692421 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:26.692553 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:26.695415 (+ 2862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.696730 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.699107 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.699935 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.700151 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.705901 (+ 5750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:26.705908 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:26.705913 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:26.705977 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:26.709493 (+ 3516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:26.710656 (+ 1163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:26.710661 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:26.710666 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:26.710848 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:26.711673 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:26.711683 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:26.711690 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:26.712242 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:26.712448 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:26.713731 (+ 1283us) server_negotiation.cc:299] Negotiation successful
0924 12:56:26.714105 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":354,"threads_started":1}
I20260924 12:56:26.715468 26354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.688658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:35041)
0924 12:56:26.689691 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:26.689741 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:26.691792 (+ 2051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:26.693120 (+ 1328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:26.693135 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:26.693945 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:26.694965 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.695002 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.696946 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.696950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.698855 (+ 1905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.698874 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.700242 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.700247 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.700629 (+ 382us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.701614 (+ 985us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:26.701654 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:26.705512 (+ 3858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:26.709718 (+ 4206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:26.709728 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:26.709744 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:26.710470 (+ 726us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:26.711061 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:26.711067 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:26.711072 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:26.711385 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:26.712436 (+ 1051us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:26.712446 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:26.712966 (+ 520us) client_negotiation.cc:769] Sending connection context
0924 12:56:26.713372 (+ 406us) client_negotiation.cc:240] Negotiation successful
0924 12:56:26.713988 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":435,"threads_started":1}
I20260924 12:56:26.717597 26351 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38385
I20260924 12:56:26.718139 26351 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:26.719184 26351 heartbeater.cc:511] Master 127.11.49.126:38385 requested a full tablet report, sending...
I20260924 12:56:26.721314 25902 ts_manager.cc:194] Registered new tserver with Master: fab59d7418c84dd5904ac40b6d3d7b8a (127.11.49.67:42145)
I20260924 12:56:26.722532 25902 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:35041
I20260924 12:56:26.731302 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:56:26.741739 26353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.732498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33612 (local address 127.11.49.126:38385)
0924 12:56:26.732767 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:26.732785 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:26.733448 (+ 663us) server_negotiation.cc:407] Connection header received
0924 12:56:26.733675 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:26.733680 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:26.733915 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:26.734137 (+ 222us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:56:26.734675 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.736007 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.738170 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.738734 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.738899 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.739627 (+ 728us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:56:26.740544 (+ 917us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:56:26.740707 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:26.741092 (+ 385us) server_negotiation.cc:299] Negotiation successful
0924 12:56:26.741226 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260924 12:56:26.743191 25902 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:33612:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:56:26.752179 25902 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:56:26.782969 26362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.769308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33431 (local address 127.0.0.1:59862)
0924 12:56:26.770191 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:26.770230 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:26.770423 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:26.771471 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:26.771482 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:26.771532 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:26.772178 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.772194 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.774143 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.774152 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.778445 (+ 4293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.778461 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.781618 (+ 3157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.781627 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.782049 (+ 422us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.782125 (+ 76us) client_negotiation.cc:769] Sending connection context
0924 12:56:26.782282 (+ 157us) client_negotiation.cc:240] Negotiation successful
0924 12:56:26.782503 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":118,"thread_start_us":473,"threads_started":1}
I20260924 12:56:26.783268 26363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.769596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59862 (local address 127.11.49.65:33431)
0924 12:56:26.770485 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:26.770495 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:26.770569 (+ 74us) server_negotiation.cc:407] Connection header received
0924 12:56:26.770725 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:26.770736 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:26.771131 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:26.772459 (+ 1328us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:26.772801 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.773970 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.779179 (+ 5209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.781337 (+ 2158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.782178 (+ 841us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.782523 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:26.782629 (+ 106us) server_negotiation.cc:299] Negotiation successful
0924 12:56:26.782853 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":689,"thread_start_us":504,"threads_started":1}
I20260924 12:56:26.785148 26365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.771144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50846 (local address 127.11.49.66:34343)
0924 12:56:26.772059 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:26.772072 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:26.775403 (+ 3331us) server_negotiation.cc:407] Connection header received
0924 12:56:26.775561 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:26.775573 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:26.775963 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:26.776219 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:26.777759 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.779160 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.782145 (+ 2985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.783809 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.784006 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.784248 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:26.784585 (+ 337us) server_negotiation.cc:299] Negotiation successful
0924 12:56:26.784772 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":535,"threads_started":1}
I20260924 12:56:26.785212 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.770699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:34343 (local address 127.0.0.1:50846)
0924 12:56:26.775043 (+ 4344us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:26.775064 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:26.775214 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:26.776627 (+ 1413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:26.776636 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:26.776676 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:26.777524 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.777539 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.779359 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.779364 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.781863 (+ 2499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.781883 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.784114 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.784122 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.784352 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.784397 (+ 45us) client_negotiation.cc:769] Sending connection context
0924 12:56:26.784513 (+ 116us) client_negotiation.cc:240] Negotiation successful
0924 12:56:26.784684 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4173,"mutex_wait_us":1,"thread_start_us":3994,"threads_started":1}
I20260924 12:56:26.788005 26022 tablet_service.cc:1467] Processing CreateTablet for tablet 8a6fd3ae44c64f698bd06a1a7d46ab03 (DEFAULT_TABLE table=test-table [id=2d973151712b4dd695d90721be826ae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:26.789597 26022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a6fd3ae44c64f698bd06a1a7d46ab03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:26.789513 26154 tablet_service.cc:1467] Processing CreateTablet for tablet 8a6fd3ae44c64f698bd06a1a7d46ab03 (DEFAULT_TABLE table=test-table [id=2d973151712b4dd695d90721be826ae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:26.790882 26154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a6fd3ae44c64f698bd06a1a7d46ab03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:26.796490 26366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.775122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:42145 (local address 127.0.0.1:42066)
0924 12:56:26.777634 (+ 2512us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:26.777660 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:26.777852 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:26.778849 (+ 997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:26.778854 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:26.778886 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:26.779315 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.779330 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.780874 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.780882 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.785267 (+ 4385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.785285 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.795290 (+ 10005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.795300 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.795532 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.795581 (+ 49us) client_negotiation.cc:769] Sending connection context
0924 12:56:26.795816 (+ 235us) client_negotiation.cc:240] Negotiation successful
0924 12:56:26.796002 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2337,"mutex_wait_us":80,"thread_start_us":2128,"threads_started":1}
I20260924 12:56:26.796746 26367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.775632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42066 (local address 127.11.49.67:42145)
0924 12:56:26.776558 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:26.776571 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:26.778059 (+ 1488us) server_negotiation.cc:407] Connection header received
0924 12:56:26.778192 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:26.778202 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:26.778568 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:26.778823 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:26.779555 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.780734 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.792556 (+ 11822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.794955 (+ 2399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.795164 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.795460 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:26.795891 (+ 431us) server_negotiation.cc:299] Negotiation successful
0924 12:56:26.796116 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":506,"threads_started":1}
I20260924 12:56:26.801476 26286 tablet_service.cc:1467] Processing CreateTablet for tablet 8a6fd3ae44c64f698bd06a1a7d46ab03 (DEFAULT_TABLE table=test-table [id=2d973151712b4dd695d90721be826ae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:26.803090 26286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a6fd3ae44c64f698bd06a1a7d46ab03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:26.805800 26368 tablet_bootstrap.cc:492] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Bootstrap starting.
I20260924 12:56:26.812127 26368 tablet_bootstrap.cc:654] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:26.813371 26369 tablet_bootstrap.cc:492] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: Bootstrap starting.
I20260924 12:56:26.814158 26368 log.cc:824] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:26.817864 26369 tablet_bootstrap.cc:654] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:26.818495 26368 tablet_bootstrap.cc:492] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: No bootstrap required, opened a new log
I20260924 12:56:26.818933 26368 ts_tablet_manager.cc:1397] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.010s
I20260924 12:56:26.819725 26369 log.cc:824] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:26.823704 26369 tablet_bootstrap.cc:492] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: No bootstrap required, opened a new log
I20260924 12:56:26.824021 26369 ts_tablet_manager.cc:1397] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260924 12:56:26.824182 26371 tablet_bootstrap.cc:492] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: Bootstrap starting.
I20260924 12:56:26.828094 26371 tablet_bootstrap.cc:654] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:26.829517 26371 log.cc:824] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:26.829561 26368 raft_consensus.cc:348] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:26.830224 26368 raft_consensus.cc:374] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:26.830351 26368 raft_consensus.cc:729] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb22e217ceb249f0a25bebf9fda97398, State: Initialized, Role: FOLLOWER
I20260924 12:56:26.831367 26368 consensus_queue.cc:260] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:26.833772 26368 ts_tablet_manager.cc:1428] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260924 12:56:26.834661 26371 tablet_bootstrap.cc:492] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: No bootstrap required, opened a new log
I20260924 12:56:26.835048 26371 ts_tablet_manager.cc:1397] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20260924 12:56:26.834815 26369 raft_consensus.cc:348] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:26.835297 26369 raft_consensus.cc:374] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:26.835412 26369 raft_consensus.cc:729] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c64c282d32644001b39468838530668e, State: Initialized, Role: FOLLOWER
I20260924 12:56:26.836086 26369 consensus_queue.cc:260] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:26.837337 26219 heartbeater.cc:503] Master 127.11.49.126:38385 was elected leader, sending a full tablet report...
I20260924 12:56:26.838182 26369 ts_tablet_manager.cc:1428] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260924 12:56:26.848946 26371 raft_consensus.cc:348] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:26.849768 26371 raft_consensus.cc:374] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:26.849911 26371 raft_consensus.cc:729] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab59d7418c84dd5904ac40b6d3d7b8a, State: Initialized, Role: FOLLOWER
I20260924 12:56:26.850883 26371 consensus_queue.cc:260] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:26.852587 26351 heartbeater.cc:503] Master 127.11.49.126:38385 was elected leader, sending a full tablet report...
I20260924 12:56:26.853479 26371 ts_tablet_manager.cc:1428] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: Time spent starting tablet: real 0.018s user 0.019s sys 0.000s
W20260924 12:56:26.936318 26352 tablet.cc:2369] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:56:26.953517 26376 raft_consensus.cc:482] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:56:26.953888 26376 raft_consensus.cc:504] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:26.956450 26376 leader_election.cc:288] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb22e217ceb249f0a25bebf9fda97398 (127.11.49.65:33431), c64c282d32644001b39468838530668e (127.11.49.66:34343)
I20260924 12:56:26.964653 26363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.956910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:51217 (local address 127.11.49.65:33431)
0924 12:56:26.957152 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:26.957161 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:26.957259 (+ 98us) server_negotiation.cc:407] Connection header received
0924 12:56:26.957588 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:26.957597 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:26.957691 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:26.957790 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:26.958652 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.959839 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.962452 (+ 2613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.963643 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.963837 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.963918 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:26.964232 (+ 314us) server_negotiation.cc:299] Negotiation successful
0924 12:56:26.964399 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260924 12:56:26.964788 26354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.956783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33431 (local address 127.11.49.67:51217)
0924 12:56:26.957107 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:26.957134 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:26.957397 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:26.958027 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:26.958035 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:26.958070 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:26.958341 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.958354 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.960009 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.960013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.962234 (+ 2221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.962252 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.963841 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.963846 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.964034 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.964066 (+ 32us) client_negotiation.cc:769] Sending connection context
0924 12:56:26.964162 (+ 96us) client_negotiation.cc:240] Negotiation successful
0924 12:56:26.964408 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":1}
I20260924 12:56:26.965291 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.957293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:34343 (local address 127.11.49.67:38625)
0924 12:56:26.958496 (+ 1203us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:26.958518 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:26.958695 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:26.959128 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:26.959131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:26.959152 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:26.959465 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.959474 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.960676 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.960681 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.962727 (+ 2046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:26.962738 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.964426 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.964431 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:26.964621 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.964653 (+ 32us) client_negotiation.cc:769] Sending connection context
0924 12:56:26.964755 (+ 102us) client_negotiation.cc:240] Negotiation successful
0924 12:56:26.964933 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1050,"thread_start_us":716,"threads_started":1}
I20260924 12:56:26.965969 26042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a6fd3ae44c64f698bd06a1a7d46ab03" candidate_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb22e217ceb249f0a25bebf9fda97398" is_pre_election: true
I20260924 12:56:26.966414 26365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:26.957556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:38625 (local address 127.11.49.66:34343)
0924 12:56:26.957846 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:26.957854 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:26.958649 (+ 795us) server_negotiation.cc:407] Connection header received
0924 12:56:26.958874 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:26.958879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:26.958978 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:26.959108 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:26.959627 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.960518 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.962903 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:26.964131 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:26.964363 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:26.964431 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:26.965043 (+ 612us) server_negotiation.cc:299] Negotiation successful
0924 12:56:26.965210 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260924 12:56:26.966568 26042 raft_consensus.cc:2454] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab59d7418c84dd5904ac40b6d3d7b8a in term 0.
I20260924 12:56:26.967469 26239 leader_election.cc:302] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb22e217ceb249f0a25bebf9fda97398, fab59d7418c84dd5904ac40b6d3d7b8a; no voters:
I20260924 12:56:26.967592 26174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a6fd3ae44c64f698bd06a1a7d46ab03" candidate_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c64c282d32644001b39468838530668e" is_pre_election: true
I20260924 12:56:26.968034 26376 raft_consensus.cc:2781] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:56:26.968215 26376 raft_consensus.cc:482] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:56:26.968093 26174 raft_consensus.cc:2454] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fab59d7418c84dd5904ac40b6d3d7b8a in term 0.
I20260924 12:56:26.968380 26376 raft_consensus.cc:3037] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:26.971351 26376 raft_consensus.cc:504] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:26.972236 26376 leader_election.cc:288] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [CANDIDATE]: Term 1 election: Requested vote from peers bb22e217ceb249f0a25bebf9fda97398 (127.11.49.65:33431), c64c282d32644001b39468838530668e (127.11.49.66:34343)
I20260924 12:56:26.973232 26042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a6fd3ae44c64f698bd06a1a7d46ab03" candidate_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb22e217ceb249f0a25bebf9fda97398"
I20260924 12:56:26.973516 26042 raft_consensus.cc:3037] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:26.976089 26042 raft_consensus.cc:2454] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab59d7418c84dd5904ac40b6d3d7b8a in term 1.
I20260924 12:56:26.976624 26174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a6fd3ae44c64f698bd06a1a7d46ab03" candidate_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c64c282d32644001b39468838530668e"
I20260924 12:56:26.976845 26174 raft_consensus.cc:3037] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:26.976760 26239 leader_election.cc:302] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb22e217ceb249f0a25bebf9fda97398, fab59d7418c84dd5904ac40b6d3d7b8a; no voters:
I20260924 12:56:26.977322 26376 raft_consensus.cc:2781] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:56:26.977980 26376 raft_consensus.cc:686] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 1 LEADER]: Becoming Leader. State: Replica: fab59d7418c84dd5904ac40b6d3d7b8a, State: Running, Role: LEADER
I20260924 12:56:26.978677 26376 consensus_queue.cc:237] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } }
I20260924 12:56:26.980103 26174 raft_consensus.cc:2454] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fab59d7418c84dd5904ac40b6d3d7b8a in term 1.
I20260924 12:56:26.984829 25901 catalog_manager.cc:5495] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to fab59d7418c84dd5904ac40b6d3d7b8a (127.11.49.67). New cstate: current_term: 1 leader_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fab59d7418c84dd5904ac40b6d3d7b8a" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42145 } health_report { overall_health: HEALTHY } } }
W20260924 12:56:27.012247 26088 tablet.cc:2369] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:56:27.037173 26367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.030498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42068 (local address 127.11.49.67:42145)
0924 12:56:27.030746 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:27.030751 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:27.030774 (+ 23us) server_negotiation.cc:407] Connection header received
0924 12:56:27.030904 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:27.030910 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:27.031026 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:27.031217 (+ 191us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:56:27.031669 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:27.032618 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:27.034297 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:27.034793 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:27.034925 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:27.035573 (+ 648us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:56:27.036445 (+ 872us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:56:27.036607 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:27.036796 (+ 189us) server_negotiation.cc:299] Negotiation successful
0924 12:56:27.036900 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260924 12:56:27.047914 26042 raft_consensus.cc:1261] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398 [term 1 FOLLOWER]: Refusing update from remote peer fab59d7418c84dd5904ac40b6d3d7b8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:56:27.047917 26174 raft_consensus.cc:1261] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e [term 1 FOLLOWER]: Refusing update from remote peer fab59d7418c84dd5904ac40b6d3d7b8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:56:27.049335 26378 consensus_queue.cc:1035] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb22e217ceb249f0a25bebf9fda97398" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 33431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:56:27.049831 26376 consensus_queue.cc:1035] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c64c282d32644001b39468838530668e" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260924 12:56:27.053109 26220 tablet.cc:2369] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:56:27.072134 26381 mvcc.cc:205] Tried to move back new op lower bound from 7332882788534157312 to 7332882788269797376. Current Snapshot: MvccSnapshot[applied={T|T < 7332882788534157312}]
I20260924 12:56:27.077041 26382 mvcc.cc:205] Tried to move back new op lower bound from 7332882788534157312 to 7332882788269797376. Current Snapshot: MvccSnapshot[applied={T|T < 7332882788534157312}]
I20260924 12:56:27.077739 26383 mvcc.cc:205] Tried to move back new op lower bound from 7332882788534157312 to 7332882788269797376. Current Snapshot: MvccSnapshot[applied={T|T < 7332882788534157312}]
I20260924 12:56:27.099375 25902 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:33612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:56:27.099774 25902 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:33612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:56:27.104981 25902 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Sending DeleteTablet for 3 replicas of tablet 8a6fd3ae44c64f698bd06a1a7d46ab03
I20260924 12:56:27.106528 26022 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a6fd3ae44c64f698bd06a1a7d46ab03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:27 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:59862
I20260924 12:56:27.106990 26286 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a6fd3ae44c64f698bd06a1a7d46ab03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:27 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:42066
I20260924 12:56:27.108080 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 25939
I20260924 12:56:27.108114 26154 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a6fd3ae44c64f698bd06a1a7d46ab03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:27 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:50846
I20260924 12:56:27.108261 26390 tablet_replica.cc:330] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: stopping tablet replica
I20260924 12:56:27.109030 26390 raft_consensus.cc:2229] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:56:27.111073 26390 raft_consensus.cc:2258] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:27.117292 26390 ts_tablet_manager.cc:1905] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:27.135965 26392 tablet_replica.cc:330] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: stopping tablet replica
I20260924 12:56:27.136649 26392 raft_consensus.cc:2229] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:56:27.137327 26392 raft_consensus.cc:2258] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:27.137135 26390 ts_tablet_manager.cc:1918] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:27.138358 26391 tablet_replica.cc:330] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: stopping tablet replica
I20260924 12:56:27.138875 26391 raft_consensus.cc:2229] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:56:27.139523 26363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.109472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59876 (local address 127.11.49.65:33431)
0924 12:56:27.109724 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:27.109734 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:27.109765 (+ 31us) server_negotiation.cc:407] Connection header received
0924 12:56:27.109970 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:27.109978 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:27.110084 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:27.110250 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:27.112969 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:27.114241 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:27.121275 (+ 7034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:27.122057 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:27.122272 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:27.129795 (+ 7523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:27.129823 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:27.129849 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:27.129959 (+ 110us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:27.135064 (+ 5105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:27.136414 (+ 1350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:27.136426 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:27.136430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:27.136641 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:27.137241 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:27.137246 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:27.137250 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:27.137839 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:27.138235 (+ 396us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:27.138711 (+ 476us) server_negotiation.cc:299] Negotiation successful
0924 12:56:27.139029 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260924 12:56:27.140143 26391 raft_consensus.cc:2258] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:27.140467 26082 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:27.142165 26392 ts_tablet_manager.cc:1905] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:27.138511 26390 log.cc:1196] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/8a6fd3ae44c64f698bd06a1a7d46ab03
I20260924 12:56:27.150566 26391 ts_tablet_manager.cc:1905] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:27.154008 26392 ts_tablet_manager.cc:1918] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:27.154245 26392 log.cc:1196] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/8a6fd3ae44c64f698bd06a1a7d46ab03
I20260924 12:56:27.154834 26392 ts_tablet_manager.cc:1939] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P c64c282d32644001b39468838530668e: Deleting consensus metadata
I20260924 12:56:27.157095 25886 catalog_manager.cc:4841] TS c64c282d32644001b39468838530668e (127.11.49.66:34343): tablet 8a6fd3ae44c64f698bd06a1a7d46ab03 (table test-table [id=2d973151712b4dd695d90721be826ae0]) successfully deleted
I20260924 12:56:27.159420 26391 ts_tablet_manager.cc:1918] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:27.159646 26391 log.cc:1196] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/8a6fd3ae44c64f698bd06a1a7d46ab03
I20260924 12:56:27.160225 26391 ts_tablet_manager.cc:1939] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P fab59d7418c84dd5904ac40b6d3d7b8a: Deleting consensus metadata
I20260924 12:56:27.162168 25886 catalog_manager.cc:4841] TS fab59d7418c84dd5904ac40b6d3d7b8a (127.11.49.67:42145): tablet 8a6fd3ae44c64f698bd06a1a7d46ab03 (table test-table [id=2d973151712b4dd695d90721be826ae0]) successfully deleted
I20260924 12:56:27.304903 26390 ts_tablet_manager.cc:1939] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Deleting consensus metadata
I20260924 12:56:27.305001 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 25939
W20260924 12:56:27.326493 25886 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.49.65:33431 (error 108)
I20260924 12:56:27.326954 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 26091
I20260924 12:56:27.329598 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.328195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33431 (local address 127.0.0.1:59880)
0924 12:56:27.329138 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:27.329316 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":771,"thread_start_us":615,"threads_started":1}
W20260924 12:56:27.329978 25886 catalog_manager.cc:4584] TS bb22e217ceb249f0a25bebf9fda97398 (127.11.49.65:33431): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8a6fd3ae44c64f698bd06a1a7d46ab03: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33431: connect: Connection refused (error 111)
I20260924 12:56:27.344624 26365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.328069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50856 (local address 127.11.49.66:34343)
0924 12:56:27.328317 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:27.328327 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:27.328504 (+ 177us) server_negotiation.cc:407] Connection header received
0924 12:56:27.328730 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:27.328740 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:27.328862 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:27.328992 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:27.330869 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:27.331703 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:27.333497 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:27.333965 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:27.334122 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:27.337382 (+ 3260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:27.337400 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:27.337417 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:27.337459 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:27.341287 (+ 3828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:27.342191 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:27.342199 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:27.342201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:27.342347 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:27.342798 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:27.342802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:27.342805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:27.343223 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:27.343571 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:27.343922 (+ 351us) server_negotiation.cc:299] Negotiation successful
0924 12:56:27.344172 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260924 12:56:27.345371 26214 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:27.384358 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.383556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33431 (local address 127.0.0.1:59886)
0924 12:56:27.383928 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:27.384102 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
I20260924 12:56:27.386233 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.385499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33431 (local address 127.0.0.1:59892)
0924 12:56:27.385801 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:27.385971 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260924 12:56:27.448144 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.446771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33431 (local address 127.0.0.1:59904)
0924 12:56:27.447741 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:27.447903 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260924 12:56:27.448716 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 26091
I20260924 12:56:27.451807 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.449835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33431 (local address 127.0.0.1:59918)
0924 12:56:27.451451 (+ 1616us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:27.451574 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260924 12:56:27.469008 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 26223
I20260924 12:56:27.488191 26367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.470034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42080 (local address 127.11.49.67:42145)
0924 12:56:27.470247 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:27.470255 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:27.470275 (+ 20us) server_negotiation.cc:407] Connection header received
0924 12:56:27.470525 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:27.470529 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:27.470607 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:27.470722 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:27.472146 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:27.473095 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:27.474432 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:27.474879 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:27.475027 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:27.479339 (+ 4312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:27.479355 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:27.479371 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:27.479421 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:27.483430 (+ 4009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:27.484936 (+ 1506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:27.484944 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:27.484946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:27.485161 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:27.485877 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:27.485886 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:27.485891 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:27.486530 (+ 639us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:27.486868 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:27.487582 (+ 714us) server_negotiation.cc:299] Negotiation successful
0924 12:56:27.487822 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260924 12:56:27.489228 26346 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:27.532972 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.532435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33431 (local address 127.0.0.1:59932)
0924 12:56:27.532630 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:27.532750 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260924 12:56:27.534560 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.534007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33431 (local address 127.0.0.1:59946)
0924 12:56:27.534298 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:27.534389 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
I20260924 12:56:27.648563 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 26223
I20260924 12:56:27.669723 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 25869
I20260924 12:56:27.671546 25932 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:27.812351 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:27.811598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:33431 (local address 127.0.0.1:59960)
0924 12:56:27.811955 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:27.812108 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:33431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222}
I20260924 12:56:27.812640 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 25869
I20260924 12:56:27.836184 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38385
--webserver_interface=127.11.49.126
--webserver_port=36037
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:38385
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:28.234391 26399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:28.234843 26399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:28.235028 26399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:28.243960 26399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:56:28.244138 26399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:28.244232 26399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:28.244361 26399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:56:28.244437 26399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:56:28.257268 26399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:38385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=36037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:28.259563 26399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:28.261806 26399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:28.277956 26407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:28.277982 26405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:28.278254 26404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:28.279095 26399 server_base.cc:1034] running on GCE node
I20260924 12:56:28.280141 26399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:28.282279 26399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:28.283624 26399 hybrid_clock.cc:648] HybridClock initialized: now 1790254588283564 us; error 77 us; skew 500 ppm
I20260924 12:56:28.284164 26399 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:28 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254588, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:28.288800 26399 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:56:28.291122 26399 webserver.cc:460] Webserver started at http://127.11.49.126:36037/ using document root <none> and password file <none>
I20260924 12:56:28.292099 26399 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:28.292338 26399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:28.300483 26399 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260924 12:56:28.305120 26414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:28.307431 26399 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.002s
I20260924 12:56:28.307778 26399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "6012d4b525534aa1abbbfa2dbdb939f5"
format_stamp: "Formatted at 2026-09-24 12:56:20 on dist-test-slave-m9hg"
server_key: "30b45a6e8c077bef91eee29473ec8fe4"
server_key_iv: "7fcb5c7f9ff8ddf31c548623d02c6f63"
server_key_version: "encryptionkey@0"
I20260924 12:56:28.309230 26399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:28.348562 26399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:28.354864 26399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:28.355273 26399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:28.382525 26399 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:38385
I20260924 12:56:28.382539 26465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:38385 every 8 connection(s)
I20260924 12:56:28.384819 26399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:56:28.389081 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 26399
I20260924 12:56:28.390144 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:33431
--local_ip_for_outbound_sockets=127.11.49.65
--tserver_master_addrs=127.11.49.126:38385
--webserver_port=42595
--webserver_interface=127.11.49.65
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:56:28.394659 26466 sys_catalog.cc:263] Verifying existing consensus state
I20260924 12:56:28.400231 26466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Bootstrap starting.
I20260924 12:56:28.422958 26466 log.cc:824] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:28.440634 26466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 12:56:28.441316 26466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5: Bootstrap complete.
I20260924 12:56:28.452250 26466 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:28.453536 26466 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6012d4b525534aa1abbbfa2dbdb939f5, State: Initialized, Role: FOLLOWER
I20260924 12:56:28.454308 26466 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:28.454612 26466 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:56:28.454766 26466 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:56:28.454980 26466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 2 FOLLOWER]: Advancing to term 3
I20260924 12:56:28.460028 26466 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:28.460753 26466 leader_election.cc:302] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6012d4b525534aa1abbbfa2dbdb939f5; no voters:
I20260924 12:56:28.461560 26466 leader_election.cc:288] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260924 12:56:28.461742 26470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260924 12:56:28.463325 26470 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [term 3 LEADER]: Becoming Leader. State: Replica: 6012d4b525534aa1abbbfa2dbdb939f5, State: Running, Role: LEADER
I20260924 12:56:28.463992 26470 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } }
I20260924 12:56:28.464358 26466 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:56:28.467572 26471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } } }
I20260924 12:56:28.468189 26471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:28.467535 26472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6012d4b525534aa1abbbfa2dbdb939f5. Latest consensus state: current_term: 3 leader_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6012d4b525534aa1abbbfa2dbdb939f5" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38385 } } }
I20260924 12:56:28.469169 26472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6012d4b525534aa1abbbfa2dbdb939f5 [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:28.476544 26479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:56:28.486760 26479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:56:28.488970 26479 catalog_manager.cc:1259] Loaded cluster ID: c63c524fff9f4835b296fc4c6590672d
I20260924 12:56:28.489143 26479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260924 12:56:28.492219 26479 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f45053289ad google::LogMessage::Fail() at ??:0
@ 0x7f450532b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f45053284de google::LogMessage::Flush() at ??:0
@ 0x7f4505329a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f451ad5f512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f451ad5c976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f451ade4610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f451ade4439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f4507f74345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4507f7791c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f4507f77799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f4507f52eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f450b22c6db start_thread at ??:0
@ 0x7f45041c261f clone at ??:0
W20260924 12:56:28.916065 26468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:28.916546 26468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:28.916682 26468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:28.925649 26468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:28.925824 26468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:28.925964 26468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:56:28.939164 26468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:33431
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=42595
--tserver_master_addrs=127.11.49.126:38385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:28.941025 26468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:28.942802 26468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:28.961539 26507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:28.965082 26510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:28.965083 26508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:28.965121 26468 server_base.cc:1034] running on GCE node
I20260924 12:56:28.966354 26468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:28.967612 26468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:28.968907 26468 hybrid_clock.cc:648] HybridClock initialized: now 1790254588968816 us; error 50 us; skew 500 ppm
I20260924 12:56:28.969448 26468 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:28 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254588, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:28.973857 26468 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:56:28.976193 26468 webserver.cc:460] Webserver started at http://127.11.49.65:42595/ using document root <none> and password file <none>
I20260924 12:56:28.977236 26468 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:28.977375 26468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:28.984968 26468 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.006s
I20260924 12:56:28.989362 26517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:28.991747 26468 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260924 12:56:28.992141 26468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "bb22e217ceb249f0a25bebf9fda97398"
format_stamp: "Formatted at 2026-09-24 12:56:21 on dist-test-slave-m9hg"
server_key: "84a9cbddb314f1484a90702941bbb829"
server_key_iv: "4c41207973fb44a74bce49d83111383f"
server_key_version: "encryptionkey@0"
I20260924 12:56:28.993625 26468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:29.021674 26468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:29.028254 26468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:29.028748 26468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:29.030226 26468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:29.033082 26524 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260924 12:56:29.039173 26524 ts_tablet_manager.cc:1852] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260924 12:56:29.040333 26524 ts_tablet_manager.cc:1905] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:29.048241 26524 ts_tablet_manager.cc:1918] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:29.048614 26524 ts_tablet_manager.cc:1939] T 8a6fd3ae44c64f698bd06a1a7d46ab03 P bb22e217ceb249f0a25bebf9fda97398: Deleting consensus metadata
I20260924 12:56:29.049181 26468 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260924 12:56:29.049453 26468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.017s user 0.001s sys 0.000s
I20260924 12:56:29.049651 26468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:29.049765 26468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:29.097059 26468 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:33431
I20260924 12:56:29.097129 26630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:33431 every 8 connection(s)
I20260924 12:56:29.099000 26468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:56:29.106002 26633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:29.103300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:38513)
0924 12:56:29.104537 (+ 1237us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:29.104920 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":460,"threads_started":1}
W20260924 12:56:29.106994 26631 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:38385 (0 consecutive failures): Network error: Failed to ping master at 127.11.49.126:38385: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
I20260924 12:56:29.108417 26633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:29.107777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:47999)
0924 12:56:29.108025 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:29.108133 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260924 12:56:29.109200 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 26468
I20260924 12:56:29.109637 26633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:29.109245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:36729)
0924 12:56:29.109407 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:29.109502 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260924 12:56:29.109891 26631 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260924 12:56:29.110129 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:34343
--local_ip_for_outbound_sockets=127.11.49.66
--tserver_master_addrs=127.11.49.126:38385
--webserver_port=35633
--webserver_interface=127.11.49.66
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:29.553987 26634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:29.554487 26634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:29.554675 26634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:29.563652 26634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:29.563860 26634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:29.564083 26634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:56:29.576419 26634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:34343
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=35633
--tserver_master_addrs=127.11.49.126:38385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:29.578325 26634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:29.580117 26634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:29.600986 26642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:29.601080 26640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:29.601080 26639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:29.602558 26634 server_base.cc:1034] running on GCE node
I20260924 12:56:29.603494 26634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:29.604990 26634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:29.606243 26634 hybrid_clock.cc:648] HybridClock initialized: now 1790254589606161 us; error 78 us; skew 500 ppm
I20260924 12:56:29.606698 26634 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:29 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254589, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:29.619103 26634 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:56:29.621469 26634 webserver.cc:460] Webserver started at http://127.11.49.66:35633/ using document root <none> and password file <none>
I20260924 12:56:29.622429 26634 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:29.622617 26634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:29.630076 26634 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260924 12:56:29.634279 26649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:29.636623 26634 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260924 12:56:29.636986 26634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "c64c282d32644001b39468838530668e"
format_stamp: "Formatted at 2026-09-24 12:56:22 on dist-test-slave-m9hg"
server_key: "82164b257203e4f906a2bf1a7ff6c69b"
server_key_iv: "57de4ef0fee3173f1a8333c348b7e11a"
server_key_version: "encryptionkey@0"
I20260924 12:56:29.638374 26634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:29.656033 26634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:29.661913 26634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:29.662317 26634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:29.663756 26634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:29.665752 26634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:29.666041 26634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:29.666260 26634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:29.666383 26634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:29.712566 26634 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:34343
I20260924 12:56:29.712699 26761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:34343 every 8 connection(s)
I20260924 12:56:29.714675 26634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:56:29.717048 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 26634
I20260924 12:56:29.717981 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:42145
--local_ip_for_outbound_sockets=127.11.49.67
--tserver_master_addrs=127.11.49.126:38385
--webserver_port=40285
--webserver_interface=127.11.49.67
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:33671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:56:29.729236 26764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:29.719142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:39831)
0924 12:56:29.727486 (+ 8344us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:29.727805 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7919,"thread_start_us":7643,"threads_started":1}
W20260924 12:56:29.730398 26762 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:38385 (0 consecutive failures): Network error: Failed to ping master at 127.11.49.126:38385: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
I20260924 12:56:29.731786 26764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:29.731127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:53877)
0924 12:56:29.731409 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:29.731558 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260924 12:56:29.733351 26764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:29.732743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:45409)
0924 12:56:29.732990 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:29.733131 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260924 12:56:29.733793 26762 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260924 12:56:30.111905 26766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:30.110819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:59013)
0924 12:56:30.111554 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:30.111666 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":368,"threads_started":1}
W20260924 12:56:30.164414 26765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:30.164846 26765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:30.164978 26765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:30.174860 26765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:30.175060 26765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:30.175202 26765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:56:30.187875 26765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:33671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:42145
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=40285
--tserver_master_addrs=127.11.49.126:38385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:30.189797 26765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:30.191524 26765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:30.210640 26772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:30.210692 26774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:30.211531 26771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:30.212000 26765 server_base.cc:1034] running on GCE node
I20260924 12:56:30.213083 26765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:30.214586 26765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:30.216005 26765 hybrid_clock.cc:648] HybridClock initialized: now 1790254590215921 us; error 58 us; skew 500 ppm
I20260924 12:56:30.216681 26765 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:30 dist-test-slave-m9hg krb5kdc[25316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:30.221115 26765 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:56:30.223217 26765 webserver.cc:460] Webserver started at http://127.11.49.67:40285/ using document root <none> and password file <none>
I20260924 12:56:30.224160 26765 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:30.224407 26765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:30.231980 26765 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.001s
I20260924 12:56:30.236486 26781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:30.238848 26765 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260924 12:56:30.239183 26765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "fab59d7418c84dd5904ac40b6d3d7b8a"
format_stamp: "Formatted at 2026-09-24 12:56:23 on dist-test-slave-m9hg"
server_key: "dc6346b6d70726e18d2fffd6f0837534"
server_key_iv: "55ffea12c8dd1f9126f582a87ffc1352"
server_key_version: "encryptionkey@0"
I20260924 12:56:30.240629 26765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:30.263139 26765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:30.268854 26765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:30.269282 26765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:30.270766 26765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:30.272706 26765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:30.272826 26765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:30.273037 26765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:30.273120 26765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:30.315802 26765 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:42145
I20260924 12:56:30.315950 26893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:42145 every 8 connection(s)
I20260924 12:56:30.317847 26765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:56:30.321502 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 26765
I20260924 12:56:30.325134 26896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:30.322301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:49745)
0924 12:56:30.323586 (+ 1285us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:30.323897 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":903,"thread_start_us":587,"threads_started":1}
W20260924 12:56:30.326087 26894 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:38385 (0 consecutive failures): Network error: Failed to ping master at 127.11.49.126:38385: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
I20260924 12:56:30.327205 26896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:30.326816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:58125)
0924 12:56:30.327007 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:30.327089 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260924 12:56:30.328538 26896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:30.328036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:46025)
0924 12:56:30.328213 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:30.328396 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260924 12:56:30.328914 26894 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260924 12:56:30.735948 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:30.734752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:45079)
0924 12:56:30.735453 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:30.735602 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":417,"threads_started":1}
I20260924 12:56:31.114288 26899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:31.113259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:37337)
0924 12:56:31.113940 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:31.114055 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":362,"threads_started":1}
I20260924 12:56:31.330937 26900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:31.329810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:41455)
0924 12:56:31.330464 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:31.330637 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":312,"threads_started":1}
I20260924 12:56:31.738485 26901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:31.737381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:35211)
0924 12:56:31.738139 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:31.738268 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":403,"threads_started":1}
I20260924 12:56:32.116711 26902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:32.115564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:40393)
0924 12:56:32.116260 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:32.116487 (+ 227us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":358,"threads_started":1}
I20260924 12:56:32.333683 26903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:32.332644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:43607)
0924 12:56:32.333370 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:32.333490 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":355,"threads_started":1}
I20260924 12:56:32.741015 26904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:32.739894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:53369)
0924 12:56:32.740607 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:32.740731 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":312,"threads_started":1}
I20260924 12:56:33.119247 26905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:33.118223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:36657)
0924 12:56:33.118900 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:33.119026 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":345,"threads_started":1}
I20260924 12:56:33.336199 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:33.335077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:41667)
0924 12:56:33.335882 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:33.335992 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":389,"threads_started":1}
I20260924 12:56:33.743657 26907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:33.742493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:60119)
0924 12:56:33.743300 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:33.743434 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":484,"threads_started":1}
I20260924 12:56:34.121980 26908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:34.120884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:51513)
0924 12:56:34.121601 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:34.121750 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":384,"threads_started":1}
I20260924 12:56:34.338447 26909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:34.337471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:42199)
0924 12:56:34.338082 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:34.338223 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":311,"threads_started":1}
I20260924 12:56:34.746488 26910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:34.745338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:36329)
0924 12:56:34.746060 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:34.746159 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":433,"threads_started":1}
I20260924 12:56:35.124308 26911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:35.123314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:48793)
0924 12:56:35.123958 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:35.124066 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":338,"threads_started":1}
I20260924 12:56:35.341463 26912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:35.340094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:48153)
0924 12:56:35.341033 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:35.341166 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":627,"threads_started":1}
I20260924 12:56:35.749116 26913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:35.748027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:47561)
0924 12:56:35.748797 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:35.748933 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":457,"threads_started":1}
I20260924 12:56:36.126940 26914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:36.125898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:49085)
0924 12:56:36.126615 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:36.126732 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":357,"threads_started":1}
I20260924 12:56:36.344039 26915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:36.342885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:60805)
0924 12:56:36.343658 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:36.343806 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":406,"threads_started":1}
I20260924 12:56:36.751708 26916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:36.750674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:37859)
0924 12:56:36.751359 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:36.751466 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":314,"threads_started":1}
I20260924 12:56:37.129366 26917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:37.128439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:52619)
0924 12:56:37.129043 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:37.129175 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":304,"threads_started":1}
I20260924 12:56:37.346473 26918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:37.345307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:40315)
0924 12:56:37.346081 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:37.346204 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":403,"threads_started":1}
I20260924 12:56:37.754133 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:37.753118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:50641)
0924 12:56:37.753817 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:37.753949 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":398,"threads_started":1}
I20260924 12:56:38.131669 26920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:38.130651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:40093)
0924 12:56:38.131308 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:38.131435 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":339,"threads_started":1}
I20260924 12:56:38.348837 26921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:38.347734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:53943)
0924 12:56:38.348500 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:38.348635 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":344,"threads_started":1}
I20260924 12:56:38.756474 26922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:38.755219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:35065)
0924 12:56:38.756001 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:38.756132 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":402,"threads_started":1}
I20260924 12:56:39.134167 26923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:39.133205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:51067)
0924 12:56:39.133813 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:39.133968 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":313,"threads_started":1}
I20260924 12:56:39.350952 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:39.349982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:35149)
0924 12:56:39.350662 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:39.350756 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":399,"threads_started":1}
I20260924 12:56:39.759246 26925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:39.757908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:50029)
0924 12:56:39.758780 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:39.758945 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":401,"threads_started":1}
I20260924 12:56:40.136962 26926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:40.135606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:52137)
0924 12:56:40.136539 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:40.136679 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":489,"threads_started":1}
I20260924 12:56:40.353374 26927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:40.352055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:53833)
0924 12:56:40.352756 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:40.353128 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":460,"threads_started":1}
I20260924 12:56:40.761615 26928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:40.760570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:42603)
0924 12:56:40.761280 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:40.761399 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":346,"threads_started":1}
I20260924 12:56:41.139295 26929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:41.138349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:54981)
0924 12:56:41.138977 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:41.139090 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":336,"threads_started":1}
I20260924 12:56:41.355607 26930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:41.354665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:46627)
0924 12:56:41.355248 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:41.355365 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":270,"threads_started":1}
I20260924 12:56:41.764398 26931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:41.763074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:34473)
0924 12:56:41.763841 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:41.764124 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":417,"threads_started":1}
I20260924 12:56:42.141772 26932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:42.140738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:52971)
0924 12:56:42.141417 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:42.141549 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":372,"threads_started":1}
I20260924 12:56:42.358249 26933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:42.357073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:54199)
0924 12:56:42.357896 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:42.358031 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":424,"threads_started":1}
I20260924 12:56:42.767490 26934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:42.766331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:51367)
0924 12:56:42.767153 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:42.767286 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":335,"threads_started":1}
I20260924 12:56:43.144337 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:43.143168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:53799)
0924 12:56:43.143886 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:43.144012 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":304,"threads_started":1}
I20260924 12:56:43.360942 26936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:43.359705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:59969)
0924 12:56:43.360468 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:43.360655 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":316,"threads_started":1}
I20260924 12:56:43.770358 26937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:43.769281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:43753)
0924 12:56:43.770004 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:43.770136 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":397,"threads_started":1}
I20260924 12:56:44.147027 26938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:44.145984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:37243)
0924 12:56:44.146665 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:44.146812 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":330,"threads_started":1}
I20260924 12:56:44.363197 26939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:44.362194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:47445)
0924 12:56:44.362814 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:44.362955 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":319,"threads_started":1}
I20260924 12:56:44.773066 26940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:44.771812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.66:43203)
0924 12:56:44.772696 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:44.772815 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":454,"threads_started":1}
I20260924 12:56:45.149212 26941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:45.148220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.65:38721)
0924 12:56:45.148894 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:45.148995 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":334,"threads_started":1}
I20260924 12:56:45.325286 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 26468
I20260924 12:56:45.354417 26942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:45.326904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58730 (local address 127.11.49.65:33431)
0924 12:56:45.328510 (+ 1606us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:45.328529 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:45.328594 (+ 65us) server_negotiation.cc:407] Connection header received
0924 12:56:45.330728 (+ 2134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:45.330740 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:45.331211 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:45.331558 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:45.333829 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:45.335377 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:45.337295 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:45.338082 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:45.338261 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:45.346774 (+ 8513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:45.346786 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:45.346805 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:45.346857 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:45.350355 (+ 3498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:45.351285 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:45.351293 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:45.351301 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:45.351498 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:45.351920 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:45.351924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:45.351926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:45.352634 (+ 708us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:45.352965 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:45.353596 (+ 631us) server_negotiation.cc:299] Negotiation successful
0924 12:56:45.354080 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":418,"threads_started":1}
I20260924 12:56:45.355808 26626 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:45.365619 26944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:45.364747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38385 (local address 127.11.49.67:58085)
0924 12:56:45.365303 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:45.365420 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:38385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":312,"threads_started":1}
I20260924 12:56:45.458752 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 26468
I20260924 12:56:45.480773 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 26634
I20260924 12:56:45.508816 26945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:45.482277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47068 (local address 127.11.49.66:34343)
0924 12:56:45.482939 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:45.482953 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:45.483021 (+ 68us) server_negotiation.cc:407] Connection header received
0924 12:56:45.485117 (+ 2096us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:45.485134 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:45.485795 (+ 661us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:45.486257 (+ 462us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:45.488246 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:45.489987 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:45.492053 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:45.493212 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:45.493611 (+ 399us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:45.498330 (+ 4719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:45.498343 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:45.498370 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:45.498450 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:45.503008 (+ 4558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:45.504629 (+ 1621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:45.504640 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:45.504651 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:45.504984 (+ 333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:45.505680 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:45.505685 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:45.505688 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:45.506550 (+ 862us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:45.506912 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:45.507584 (+ 672us) server_negotiation.cc:299] Negotiation successful
0924 12:56:45.508407 (+ 823us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":325,"threads_started":1}
I20260924 12:56:45.510994 26757 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:45.617811 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 26634
I20260924 12:56:45.641616 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 26765
I20260924 12:56:45.664165 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:45.642886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39232 (local address 127.11.49.67:42145)
0924 12:56:45.643770 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:45.643786 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:45.643835 (+ 49us) server_negotiation.cc:407] Connection header received
0924 12:56:45.646077 (+ 2242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:45.646088 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:45.646865 (+ 777us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:45.647284 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:45.649104 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:45.650484 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:45.651832 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:45.652662 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:45.652886 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:45.656053 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:45.656064 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:45.656083 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:45.656136 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:45.659963 (+ 3827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:45.661023 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:45.661032 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:45.661039 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:45.661262 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:45.661750 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:45.661756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:45.661759 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:45.662422 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:45.662781 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:45.663281 (+ 500us) server_negotiation.cc:299] Negotiation successful
0924 12:56:45.663816 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":366,"threads_started":1}
I20260924 12:56:45.666574 26889 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:45.770190 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 26765
2026-09-24T12:56:45Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (26848 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:56:45 dist-test-slave-m9hg krb5kdc[26951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:56:45 dist-test-slave-m9hg krb5kdc[26951](info): set up 2 sockets
Sep 24 12:56:45 dist-test-slave-m9hg krb5kdc[26951](info): commencing operation
krb5kdc: starting...
W20260924 12:56:46.942003 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.009s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:56:47 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:56:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:56:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:56:47.246279 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42479
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:42479
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:47.661944 26964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:47.662379 26964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:47.662561 26964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:47.671077 26964 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260924 12:56:47.671226 26964 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260924 12:56:47.671325 26964 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260924 12:56:47.671411 26964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:56:47.671516 26964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:47.671644 26964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:47.671715 26964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:56:47.671797 26964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:56:47.683736 26964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:42479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:47.685645 26964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:47.687409 26964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:47.703315 26969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:47.703395 26972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:47.703568 26970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:47.705356 26964 server_base.cc:1034] running on GCE node
I20260924 12:56:47.706599 26964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:47.708724 26964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:47.710088 26964 hybrid_clock.cc:648] HybridClock initialized: now 1790254607709993 us; error 65 us; skew 500 ppm
I20260924 12:56:47.710620 26964 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:47 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254607, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:47.715116 26964 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:56:47.717545 26964 webserver.cc:460] Webserver started at http://127.11.49.126:34643/ using document root <none> and password file <none>
I20260924 12:56:47.718644 26964 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:47.718832 26964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:47.719297 26964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:47.723798 26964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "5baa77c315ff4094ba71dc9d2541850a"
format_stamp: "Formatted at 2026-09-24 12:56:47 on dist-test-slave-m9hg"
server_key: "7955682a4b94944471208fe6d3b415f6"
server_key_iv: "dcc58e0951f6ae32bd9dbee5b819d57c"
server_key_version: "encryptionkey@0"
I20260924 12:56:47.725205 26964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "5baa77c315ff4094ba71dc9d2541850a"
format_stamp: "Formatted at 2026-09-24 12:56:47 on dist-test-slave-m9hg"
server_key: "7955682a4b94944471208fe6d3b415f6"
server_key_iv: "dcc58e0951f6ae32bd9dbee5b819d57c"
server_key_version: "encryptionkey@0"
I20260924 12:56:47.733363 26964 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260924 12:56:47.739108 26979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:47.741525 26964 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260924 12:56:47.741878 26964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "5baa77c315ff4094ba71dc9d2541850a"
format_stamp: "Formatted at 2026-09-24 12:56:47 on dist-test-slave-m9hg"
server_key: "7955682a4b94944471208fe6d3b415f6"
server_key_iv: "dcc58e0951f6ae32bd9dbee5b819d57c"
server_key_version: "encryptionkey@0"
I20260924 12:56:47.742252 26964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:47.784154 26964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:47.791443 26964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:47.791860 26964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:47.817678 26964 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:42479
I20260924 12:56:47.817667 27030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:42479 every 8 connection(s)
I20260924 12:56:47.819686 26964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:56:47.824527 27031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:47.824775 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 26964
I20260924 12:56:47.825040 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:56:47.825837 11461 external_mini_cluster.cc:1428] Setting key 537f420061bebe6e5b0aa5ccf99e3fdc
I20260924 12:56:47.842031 27031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Bootstrap starting.
Sep 24 12:56:47 dist-test-slave-m9hg krb5kdc[26951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:47.846967 27031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:47.848551 27031 log.cc:824] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:47.852445 27031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: No bootstrap required, opened a new log
I20260924 12:56:47.858952 27034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:47.828638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47454 (local address 127.11.49.126:42479)
0924 12:56:47.829774 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:47.829794 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:47.829854 (+ 60us) server_negotiation.cc:407] Connection header received
0924 12:56:47.831846 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:47.831879 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:47.832942 (+ 1063us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:47.833516 (+ 574us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:47.835776 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:47.837778 (+ 2002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:47.840261 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:47.841378 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:47.841610 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:47.848382 (+ 6772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:47.848397 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:47.848430 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:47.848643 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:47.853041 (+ 4398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:47.854167 (+ 1126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:47.854177 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:47.854186 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:47.854488 (+ 302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:47.854989 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:47.854995 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:47.855001 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:47.855836 (+ 835us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:47.856255 (+ 419us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:47.856862 (+ 607us) server_negotiation.cc:299] Negotiation successful
0924 12:56:47.857552 (+ 690us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":829,"thread_start_us":512,"threads_started":1}
I20260924 12:56:47.861152 27031 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:56:47.861681 27031 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:47.861805 27031 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5baa77c315ff4094ba71dc9d2541850a, State: Initialized, Role: FOLLOWER
I20260924 12:56:47.862461 27031 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:56:47.862748 27031 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:56:47.862950 27031 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:56:47.863178 27031 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:47.865653 27031 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:56:47.866245 27031 leader_election.cc:302] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5baa77c315ff4094ba71dc9d2541850a; no voters:
I20260924 12:56:47.867003 27031 leader_election.cc:288] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:56:47.867295 27036 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:56:47.868424 27036 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 1 LEADER]: Becoming Leader. State: Replica: 5baa77c315ff4094ba71dc9d2541850a, State: Running, Role: LEADER
I20260924 12:56:47.869324 27036 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:56:47.869738 27031 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:56:47.874382 27037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5baa77c315ff4094ba71dc9d2541850a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } } }
I20260924 12:56:47.875093 27037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:47.874382 27038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5baa77c315ff4094ba71dc9d2541850a. Latest consensus state: current_term: 1 leader_uuid: "5baa77c315ff4094ba71dc9d2541850a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } } }
I20260924 12:56:47.876680 27038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: This master's current role is: LEADER
I20260924 12:56:47.881080 27045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:56:47.888078 27045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:56:47.900801 27045 catalog_manager.cc:1347] Generated new cluster ID: 3e2b6812080648a4bd1d7a80af1a58d6
I20260924 12:56:47.900977 27045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:56:47.925837 27045 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:56:47.927634 27045 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:56:47.941251 27045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Generated new TSK 0
I20260924 12:56:47.942294 27045 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:56:48.021412 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42479
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:48.382393 27057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:48.382779 27057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:48.382961 27057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:48.390966 27057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:48.391152 27057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:48.391348 27057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:56:48.401878 27057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:48.403623 27057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:48.405228 27057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:48.421209 27065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:48.421090 27063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:48.421277 27062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:48.422917 27057 server_base.cc:1034] running on GCE node
I20260924 12:56:48.423615 27057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:48.424775 27057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:48.426069 27057 hybrid_clock.cc:648] HybridClock initialized: now 1790254608426009 us; error 50 us; skew 500 ppm
I20260924 12:56:48.426556 27057 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:48 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254608, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:48.431098 27057 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:56:48.433337 27057 webserver.cc:460] Webserver started at http://127.11.49.65:38789/ using document root <none> and password file <none>
I20260924 12:56:48.434198 27057 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:48.434386 27057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:48.434813 27057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:48.438475 27057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "cccc2a7614844c82ae3d15a15edded1a"
format_stamp: "Formatted at 2026-09-24 12:56:48 on dist-test-slave-m9hg"
server_key: "a2ee7f17c1d5e59d28e1b4d8b14a4bc3"
server_key_iv: "c906584fb96a3d74d1cff415563b6ba7"
server_key_version: "encryptionkey@0"
I20260924 12:56:48.439522 27057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "cccc2a7614844c82ae3d15a15edded1a"
format_stamp: "Formatted at 2026-09-24 12:56:48 on dist-test-slave-m9hg"
server_key: "a2ee7f17c1d5e59d28e1b4d8b14a4bc3"
server_key_iv: "c906584fb96a3d74d1cff415563b6ba7"
server_key_version: "encryptionkey@0"
I20260924 12:56:48.446390 27057 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.003s
I20260924 12:56:48.451362 27072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:48.453327 27057 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:56:48.453554 27057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "cccc2a7614844c82ae3d15a15edded1a"
format_stamp: "Formatted at 2026-09-24 12:56:48 on dist-test-slave-m9hg"
server_key: "a2ee7f17c1d5e59d28e1b4d8b14a4bc3"
server_key_iv: "c906584fb96a3d74d1cff415563b6ba7"
server_key_version: "encryptionkey@0"
I20260924 12:56:48.453799 27057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:48.484409 27057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:48.489596 27057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:48.489933 27057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:48.491089 27057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:48.492726 27057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:48.492843 27057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:48.493026 27057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:48.493106 27057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:48.537053 27057 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:36931
I20260924 12:56:48.537099 27184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:36931 every 8 connection(s)
I20260924 12:56:48.538906 27057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:56:48.539894 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 27057
I20260924 12:56:48.540148 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:56:48.541090 11461 external_mini_cluster.cc:1428] Setting key 88c4553debffcfb702cb9ef29b6061e9
Sep 24 12:56:48 dist-test-slave-m9hg krb5kdc[26951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254608, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:48.569247 27187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:48.542686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:35225 (local address 127.11.49.126:42479)
0924 12:56:48.543246 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:48.543253 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:48.545042 (+ 1789us) server_negotiation.cc:407] Connection header received
0924 12:56:48.547514 (+ 2472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:48.547523 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:48.547635 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:48.547822 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:48.550795 (+ 2973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:48.551720 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:48.553686 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:48.554526 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:48.554761 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:48.559278 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:48.559290 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:48.559300 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:48.559375 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:48.563903 (+ 4528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:48.565227 (+ 1324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:48.565237 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:48.565244 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:48.565475 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:48.566077 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:48.566085 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:48.566091 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:48.566590 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:48.566795 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:48.568160 (+ 1365us) server_negotiation.cc:299] Negotiation successful
0924 12:56:48.568650 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":321,"threads_started":1}
I20260924 12:56:48.570051 27188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:48.543613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:35225)
0924 12:56:48.544776 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:48.544837 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:48.547036 (+ 2199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:48.548523 (+ 1487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:48.548542 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:48.549527 (+ 985us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:48.550462 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:48.550495 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:48.551979 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:48.551988 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:48.553452 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:48.553469 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:48.554925 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:48.554931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:48.555178 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:48.556034 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:48.556110 (+ 76us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:48.558853 (+ 2743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:48.564265 (+ 5412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:48.564355 (+ 90us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:48.564373 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:48.564993 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:48.565658 (+ 665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:48.565663 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:48.565667 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:48.565900 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:48.566946 (+ 1046us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:48.566953 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:48.567400 (+ 447us) client_negotiation.cc:769] Sending connection context
0924 12:56:48.567800 (+ 400us) client_negotiation.cc:240] Negotiation successful
0924 12:56:48.568432 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"thread_start_us":550,"threads_started":1}
I20260924 12:56:48.572415 27185 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42479
I20260924 12:56:48.572978 27185 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:56:48.574160 27185 heartbeater.cc:511] Master 127.11.49.126:42479 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
I20260924 12:56:48.577390 26996 ts_manager.cc:194] Registered new tserver with Master: cccc2a7614844c82ae3d15a15edded1a (127.11.49.65:36931)
I20260924 12:56:48.579156 26996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:35225
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:56:48.617413 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42479
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:56:49.082856 27191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:49.083333 27191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:49.083532 27191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:49.093040 27191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:49.093242 27191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:49.093468 27191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:56:49.106940 27191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:49.109599 27191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:49.111667 27191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:49.136246 27196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:49.136566 27199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:49.136557 27197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:49.138254 27191 server_base.cc:1034] running on GCE node
I20260924 12:56:49.139153 27191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:49.140775 27191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:49.142270 27191 hybrid_clock.cc:648] HybridClock initialized: now 1790254609142188 us; error 76 us; skew 500 ppm
I20260924 12:56:49.142956 27191 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:49 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254609, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:49.148672 27191 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:56:49.151785 27191 webserver.cc:460] Webserver started at http://127.11.49.66:41727/ using document root <none> and password file <none>
I20260924 12:56:49.153008 27191 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:49.153229 27191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:49.153672 27191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:49.158485 27191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb"
format_stamp: "Formatted at 2026-09-24 12:56:49 on dist-test-slave-m9hg"
server_key: "8eb1ce569b7be37bec08e5184b70093e"
server_key_iv: "c3a56bbab13eb2edfcb081097362d8f2"
server_key_version: "encryptionkey@0"
I20260924 12:56:49.160626 27191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb"
format_stamp: "Formatted at 2026-09-24 12:56:49 on dist-test-slave-m9hg"
server_key: "8eb1ce569b7be37bec08e5184b70093e"
server_key_iv: "c3a56bbab13eb2edfcb081097362d8f2"
server_key_version: "encryptionkey@0"
I20260924 12:56:49.171729 27191 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.009s sys 0.000s
I20260924 12:56:49.178474 27206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:49.181398 27191 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260924 12:56:49.181702 27191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb"
format_stamp: "Formatted at 2026-09-24 12:56:49 on dist-test-slave-m9hg"
server_key: "8eb1ce569b7be37bec08e5184b70093e"
server_key_iv: "c3a56bbab13eb2edfcb081097362d8f2"
server_key_version: "encryptionkey@0"
I20260924 12:56:49.182067 27191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:49.224869 27191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:49.231793 27191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:49.232167 27191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:49.233688 27191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:49.236004 27191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:49.236174 27191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:49.236580 27191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:49.236732 27191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:49.283500 27191 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:44419
I20260924 12:56:49.283573 27318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:44419 every 8 connection(s)
I20260924 12:56:49.285379 27191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:56:49.295678 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 27191
I20260924 12:56:49.295876 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:56:49.296572 11461 external_mini_cluster.cc:1428] Setting key a49be47cb151c951c622cf32615a2314
Sep 24 12:56:49 dist-test-slave-m9hg krb5kdc[26951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254609, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:49.315199 27321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:49.288987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:58531 (local address 127.11.49.126:42479)
0924 12:56:49.289619 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:49.289627 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:49.290826 (+ 1199us) server_negotiation.cc:407] Connection header received
0924 12:56:49.293730 (+ 2904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:49.293735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:49.293843 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:49.293985 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:49.296572 (+ 2587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:49.297773 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:49.300520 (+ 2747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:49.301459 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:49.301645 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:49.306644 (+ 4999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:49.306655 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:49.306664 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:49.306741 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:49.310413 (+ 3672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:49.311887 (+ 1474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:49.311892 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:49.311895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:49.312054 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:49.312812 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:49.312816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:49.312819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:49.313163 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:49.313363 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:49.314610 (+ 1247us) server_negotiation.cc:299] Negotiation successful
0924 12:56:49.314892 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":307,"threads_started":1}
I20260924 12:56:49.317315 27322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:49.289477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:58531)
0924 12:56:49.290559 (+ 1082us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:49.290628 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:49.293228 (+ 2600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:49.294338 (+ 1110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:49.294350 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:49.295118 (+ 768us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:49.296189 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:49.296223 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:49.298101 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:49.298108 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:49.300194 (+ 2086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:49.300220 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:49.301817 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:49.301825 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:49.302184 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:49.303225 (+ 1041us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:49.303258 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:49.306212 (+ 2954us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:49.310693 (+ 4481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:49.310709 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:49.310741 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:49.311644 (+ 903us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:49.312202 (+ 558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:49.312210 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:49.312216 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:49.312591 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:49.313356 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:49.313369 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:49.314047 (+ 678us) client_negotiation.cc:769] Sending connection context
0924 12:56:49.314455 (+ 408us) client_negotiation.cc:240] Negotiation successful
0924 12:56:49.315233 (+ 778us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":410,"threads_started":1}
I20260924 12:56:49.319628 27319 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42479
I20260924 12:56:49.320127 27319 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:49.321064 27319 heartbeater.cc:511] Master 127.11.49.126:42479 requested a full tablet report, sending...
I20260924 12:56:49.323088 26996 ts_manager.cc:194] Registered new tserver with Master: cbb5fcac28ab4db5aaa48f041c7a69cb (127.11.49.66:44419)
I20260924 12:56:49.324753 26996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:58531
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:56:49.369295 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42479
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:56:49.583060 27185 heartbeater.cc:503] Master 127.11.49.126:42479 was elected leader, sending a full tablet report...
W20260924 12:56:49.818260 27325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:56:49.818773 27325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:56:49.818977 27325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:56:49.828075 27325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:56:49.828336 27325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:56:49.828555 27325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:56:49.840850 27325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:42479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:56:49.842736 27325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:56:49.844671 27325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:56:49.863263 27330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:49.863910 27333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:56:49.864117 27331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:56:49.865089 27325 server_base.cc:1034] running on GCE node
I20260924 12:56:49.865947 27325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:56:49.867216 27325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:56:49.868491 27325 hybrid_clock.cc:648] HybridClock initialized: now 1790254609868449 us; error 47 us; skew 500 ppm
I20260924 12:56:49.868903 27325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:56:49 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254609, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:56:49.873291 27325 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:56:49.875324 27325 webserver.cc:460] Webserver started at http://127.11.49.67:38995/ using document root <none> and password file <none>
I20260924 12:56:49.876199 27325 fs_manager.cc:359] Metadata directory not provided
I20260924 12:56:49.876412 27325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:56:49.876772 27325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:56:49.880455 27325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "9c8e582db64d4578842f5c508e24255c"
format_stamp: "Formatted at 2026-09-24 12:56:49 on dist-test-slave-m9hg"
server_key: "ec95e2d2ad4cc72a0025bb79d98b768c"
server_key_iv: "1d6713f7953b9a82160d1eef1fe9174d"
server_key_version: "encryptionkey@0"
I20260924 12:56:49.881485 27325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "9c8e582db64d4578842f5c508e24255c"
format_stamp: "Formatted at 2026-09-24 12:56:49 on dist-test-slave-m9hg"
server_key: "ec95e2d2ad4cc72a0025bb79d98b768c"
server_key_iv: "1d6713f7953b9a82160d1eef1fe9174d"
server_key_version: "encryptionkey@0"
I20260924 12:56:49.889375 27325 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260924 12:56:49.894291 27340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:49.896262 27325 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260924 12:56:49.896574 27325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "9c8e582db64d4578842f5c508e24255c"
format_stamp: "Formatted at 2026-09-24 12:56:49 on dist-test-slave-m9hg"
server_key: "ec95e2d2ad4cc72a0025bb79d98b768c"
server_key_iv: "1d6713f7953b9a82160d1eef1fe9174d"
server_key_version: "encryptionkey@0"
I20260924 12:56:49.896832 27325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:56:49.923629 27325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:56:49.929201 27325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:56:49.929579 27325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:56:49.930893 27325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:56:49.932778 27325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:56:49.932901 27325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:49.933085 27325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:56:49.933171 27325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:56:49.978940 27325 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:46061
I20260924 12:56:49.979074 27452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:46061 every 8 connection(s)
I20260924 12:56:49.980834 27325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:56:49.983953 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 27325
I20260924 12:56:49.984246 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:56:49.985025 11461 external_mini_cluster.cc:1428] Setting key c6bfc8f88766ed002a0f9153f3a15ca6
Sep 24 12:56:49 dist-test-slave-m9hg krb5kdc[26951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254609, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:56:50.010272 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:49.984600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:48675 (local address 127.11.49.126:42479)
0924 12:56:49.985331 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:49.985340 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:49.986631 (+ 1291us) server_negotiation.cc:407] Connection header received
0924 12:56:49.989558 (+ 2927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:49.989562 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:49.989638 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:49.989744 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:49.991875 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:49.992870 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:49.995184 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:49.995621 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:49.995815 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.001676 (+ 5861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:50.001683 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:50.001686 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:50.001726 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:50.005438 (+ 3712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:50.006817 (+ 1379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:50.006824 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:50.006828 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:50.007050 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:50.007759 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:50.007763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:50.007766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:50.008110 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:50.008260 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:50.009674 (+ 1414us) server_negotiation.cc:299] Negotiation successful
0924 12:56:50.009915 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":349,"threads_started":1}
I20260924 12:56:50.011793 27456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:49.985139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:48675)
0924 12:56:49.986374 (+ 1235us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:49.986453 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:49.989150 (+ 2697us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:49.990072 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:49.990083 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:49.990820 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:56:49.991609 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:49.991647 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:49.993147 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:49.993152 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:49.994932 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:49.994954 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:49.995985 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:49.995993 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:49.996454 (+ 461us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:49.997542 (+ 1088us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:56:49.997576 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:56:50.001378 (+ 3802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:56:50.005785 (+ 4407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:50.005798 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:50.005821 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:50.006554 (+ 733us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:50.007248 (+ 694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:56:50.007253 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:56:50.007256 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:56:50.007596 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:56:50.008410 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:56:50.008419 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:56:50.009018 (+ 599us) client_negotiation.cc:769] Sending connection context
0924 12:56:50.009494 (+ 476us) client_negotiation.cc:240] Negotiation successful
0924 12:56:50.010155 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"thread_start_us":434,"threads_started":1}
I20260924 12:56:50.014520 27453 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42479
I20260924 12:56:50.015021 27453 heartbeater.cc:464] Registering TS with master...
I20260924 12:56:50.016129 27453 heartbeater.cc:511] Master 127.11.49.126:42479 requested a full tablet report, sending...
I20260924 12:56:50.018427 26996 ts_manager.cc:194] Registered new tserver with Master: 9c8e582db64d4578842f5c508e24255c (127.11.49.67:46061)
I20260924 12:56:50.019450 26996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:48675
I20260924 12:56:50.031113 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:56:50.053777 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.037937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47468 (local address 127.11.49.126:42479)
0924 12:56:50.038316 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:50.038324 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:50.038795 (+ 471us) server_negotiation.cc:407] Connection header received
0924 12:56:50.039057 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:50.039063 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:50.039177 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:50.039338 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:50.041022 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.041792 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.043351 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.043784 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.043936 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.046938 (+ 3002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:50.046944 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:50.046948 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:50.046992 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:50.050641 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:50.051531 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:50.051543 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:50.051546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:50.051677 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:50.052094 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:50.052101 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:50.052105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:50.052549 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:50.052828 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:50.053191 (+ 363us) server_negotiation.cc:299] Negotiation successful
0924 12:56:50.053439 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260924 12:56:50.059526 26996 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47468:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:56:50.069887 26996 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:56:50.105516 27467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.088641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57412 (local address 127.11.49.65:36931)
0924 12:56:50.089492 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:50.089503 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:50.090525 (+ 1022us) server_negotiation.cc:407] Connection header received
0924 12:56:50.091604 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:50.091619 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:50.092060 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:50.092321 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:50.093728 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.096085 (+ 2357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.100756 (+ 4671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.103340 (+ 2584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.103544 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.103858 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:50.104863 (+ 1005us) server_negotiation.cc:299] Negotiation successful
0924 12:56:50.105086 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":445,"threads_started":1}
I20260924 12:56:50.106503 27466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.088372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36931 (local address 127.0.0.1:57412)
0924 12:56:50.090260 (+ 1888us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:50.090340 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:50.090773 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:50.092790 (+ 2017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:50.092800 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:50.092858 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:50.093457 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:50.093475 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.096395 (+ 2920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.096404 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:50.100333 (+ 3929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:50.100372 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.104139 (+ 3767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.104145 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:50.104483 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.104567 (+ 84us) client_negotiation.cc:769] Sending connection context
0924 12:56:50.105645 (+ 1078us) client_negotiation.cc:240] Negotiation successful
0924 12:56:50.105989 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1499,"thread_start_us":1316,"threads_started":1}
I20260924 12:56:50.112170 27120 tablet_service.cc:1467] Processing CreateTablet for tablet 0e102efb86e8434e8339f35a7c04b8fb (DEFAULT_TABLE table=test-table [id=8499bfd0bdfa4c04b514a0d3ee3f78c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:50.114549 27120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e102efb86e8434e8339f35a7c04b8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:50.116441 27471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.091682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51504 (local address 127.11.49.67:46061)
0924 12:56:50.105008 (+ 13326us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:50.105018 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:50.106436 (+ 1418us) server_negotiation.cc:407] Connection header received
0924 12:56:50.106768 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:50.106777 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:50.107098 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:50.107395 (+ 297us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:50.108691 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.110621 (+ 1930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.113951 (+ 3330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.115173 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.115347 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.115616 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:50.115874 (+ 258us) server_negotiation.cc:299] Negotiation successful
0924 12:56:50.116051 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13095,"thread_start_us":12884,"threads_started":1}
I20260924 12:56:50.116473 27468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.091219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:46061 (local address 127.0.0.1:51504)
0924 12:56:50.106293 (+ 15074us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:50.106320 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:50.106525 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:50.107742 (+ 1217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:50.107748 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:50.107779 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:50.108442 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:50.108456 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.110854 (+ 2398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.110860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:50.113769 (+ 2909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:50.113780 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.115418 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.115425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:50.115614 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.115684 (+ 70us) client_negotiation.cc:769] Sending connection context
0924 12:56:50.115802 (+ 118us) client_negotiation.cc:240] Negotiation successful
0924 12:56:50.115962 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14962,"mutex_wait_us":59,"thread_start_us":13964,"threads_started":1}
I20260924 12:56:50.117895 27470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.088962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:44419 (local address 127.0.0.1:43966)
0924 12:56:50.105590 (+ 16628us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:50.105624 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:50.106663 (+ 1039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:50.107883 (+ 1220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:50.107888 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:50.107924 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:50.108790 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:50.108806 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.111044 (+ 2238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.111051 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:50.113498 (+ 2447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:50.113521 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.117042 (+ 3521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.117049 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:50.117204 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.117229 (+ 25us) client_negotiation.cc:769] Sending connection context
0924 12:56:50.117351 (+ 122us) client_negotiation.cc:240] Negotiation successful
0924 12:56:50.117489 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16446,"mutex_wait_us":102,"thread_start_us":16979,"threads_started":1}
I20260924 12:56:50.120085 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.089654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43966 (local address 127.11.49.66:44419)
0924 12:56:50.103237 (+ 13583us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:50.103254 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:50.105886 (+ 2632us) server_negotiation.cc:407] Connection header received
0924 12:56:50.107000 (+ 1114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:50.107013 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:50.107354 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:50.107613 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:50.109051 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.110837 (+ 1786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.113854 (+ 3017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.116427 (+ 2573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.116638 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.116866 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:50.117458 (+ 592us) server_negotiation.cc:299] Negotiation successful
0924 12:56:50.117743 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13266,"thread_start_us":13065,"threads_started":1}
I20260924 12:56:50.123173 27388 tablet_service.cc:1467] Processing CreateTablet for tablet 0e102efb86e8434e8339f35a7c04b8fb (DEFAULT_TABLE table=test-table [id=8499bfd0bdfa4c04b514a0d3ee3f78c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:50.124357 27254 tablet_service.cc:1467] Processing CreateTablet for tablet 0e102efb86e8434e8339f35a7c04b8fb (DEFAULT_TABLE table=test-table [id=8499bfd0bdfa4c04b514a0d3ee3f78c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:56:50.125052 27388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e102efb86e8434e8339f35a7c04b8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:50.125831 27254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e102efb86e8434e8339f35a7c04b8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:56:50.132915 27472 tablet_bootstrap.cc:492] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a: Bootstrap starting.
I20260924 12:56:50.139106 27472 tablet_bootstrap.cc:654] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:50.141178 27472 log.cc:824] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:50.143333 27473 tablet_bootstrap.cc:492] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb: Bootstrap starting.
I20260924 12:56:50.149988 27475 tablet_bootstrap.cc:492] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: Bootstrap starting.
I20260924 12:56:50.154090 27475 tablet_bootstrap.cc:654] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:50.154142 27473 tablet_bootstrap.cc:654] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb: Neither blocks nor log segments found. Creating new log.
I20260924 12:56:50.155257 27475 log.cc:824] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:50.156337 27473 log.cc:824] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb: Log is configured to *not* fsync() on all Append() calls
I20260924 12:56:50.159685 27475 tablet_bootstrap.cc:492] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: No bootstrap required, opened a new log
I20260924 12:56:50.160010 27475 ts_tablet_manager.cc:1397] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260924 12:56:50.160411 27472 tablet_bootstrap.cc:492] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a: No bootstrap required, opened a new log
I20260924 12:56:50.160626 27473 tablet_bootstrap.cc:492] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb: No bootstrap required, opened a new log
I20260924 12:56:50.160851 27472 ts_tablet_manager.cc:1397] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a: Time spent bootstrapping tablet: real 0.028s user 0.016s sys 0.010s
I20260924 12:56:50.160940 27473 ts_tablet_manager.cc:1397] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.004s
I20260924 12:56:50.168692 27475 raft_consensus.cc:348] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } } peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } }
I20260924 12:56:50.169376 27475 raft_consensus.cc:374] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:50.169510 27475 raft_consensus.cc:729] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8e582db64d4578842f5c508e24255c, State: Initialized, Role: FOLLOWER
I20260924 12:56:50.170502 27475 consensus_queue.cc:260] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } } peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } }
I20260924 12:56:50.171917 27453 heartbeater.cc:503] Master 127.11.49.126:42479 was elected leader, sending a full tablet report...
I20260924 12:56:50.174669 27475 ts_tablet_manager.cc:1428] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260924 12:56:50.174561 27472 raft_consensus.cc:348] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } } peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } }
I20260924 12:56:50.174721 27473 raft_consensus.cc:348] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } } peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } }
I20260924 12:56:50.175246 27473 raft_consensus.cc:374] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:50.175410 27472 raft_consensus.cc:374] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:56:50.175587 27472 raft_consensus.cc:729] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cccc2a7614844c82ae3d15a15edded1a, State: Initialized, Role: FOLLOWER
I20260924 12:56:50.175777 27473 raft_consensus.cc:729] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb5fcac28ab4db5aaa48f041c7a69cb, State: Initialized, Role: FOLLOWER
I20260924 12:56:50.176527 27473 consensus_queue.cc:260] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } } peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } }
I20260924 12:56:50.176887 27472 consensus_queue.cc:260] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } } peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } }
I20260924 12:56:50.178299 27319 heartbeater.cc:503] Master 127.11.49.126:42479 was elected leader, sending a full tablet report...
I20260924 12:56:50.178771 27473 ts_tablet_manager.cc:1428] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb: Time spent starting tablet: real 0.018s user 0.012s sys 0.003s
I20260924 12:56:50.181486 27472 ts_tablet_manager.cc:1428] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a: Time spent starting tablet: real 0.020s user 0.017s sys 0.002s
I20260924 12:56:50.193732 27478 raft_consensus.cc:482] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:56:50.194113 27478 raft_consensus.cc:504] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } } peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } }
I20260924 12:56:50.196028 27478 leader_election.cc:288] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cccc2a7614844c82ae3d15a15edded1a (127.11.49.65:36931), cbb5fcac28ab4db5aaa48f041c7a69cb (127.11.49.66:44419)
I20260924 12:56:50.205672 27456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.196689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:44419 (local address 127.11.49.67:37179)
0924 12:56:50.196971 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:50.196992 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:50.197136 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:50.197872 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:50.197878 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:50.197922 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:50.198191 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:50.198210 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.199683 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.199687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:50.201869 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:50.201887 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.204524 (+ 2637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.204536 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:50.204959 (+ 423us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.204985 (+ 26us) client_negotiation.cc:769] Sending connection context
0924 12:56:50.205090 (+ 105us) client_negotiation.cc:240] Negotiation successful
0924 12:56:50.205296 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":145}
I20260924 12:56:50.205745 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.196695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:37179 (local address 127.11.49.66:44419)
0924 12:56:50.197288 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:50.197296 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:50.197336 (+ 40us) server_negotiation.cc:407] Connection header received
0924 12:56:50.197456 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:50.197464 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:50.197600 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:50.197776 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:50.198408 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.199503 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.202432 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.204192 (+ 1760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.204507 (+ 315us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.204607 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:50.205222 (+ 615us) server_negotiation.cc:299] Negotiation successful
0924 12:56:50.205414 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326}
I20260924 12:56:50.205751 27467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.196538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:47241 (local address 127.11.49.65:36931)
0924 12:56:50.196780 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:50.196787 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:50.198361 (+ 1574us) server_negotiation.cc:407] Connection header received
0924 12:56:50.198504 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:50.198511 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:50.198613 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:50.198735 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:56:50.199365 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.200233 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.202901 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.204342 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.204513 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.204607 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:50.205223 (+ 616us) server_negotiation.cc:299] Negotiation successful
0924 12:56:50.205414 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260924 12:56:50.205726 27481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.196748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36931 (local address 127.11.49.67:47241)
0924 12:56:50.198135 (+ 1387us) negotiation.cc:107] Waiting for socket to connect
0924 12:56:50.198158 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:56:50.198319 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:56:50.198798 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:56:50.198802 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:56:50.198825 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:56:50.199149 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:50.199159 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.200514 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.200522 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:50.202627 (+ 2105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:56:50.202639 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.204549 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.204554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:56:50.204872 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.204959 (+ 87us) client_negotiation.cc:769] Sending connection context
0924 12:56:50.205090 (+ 131us) client_negotiation.cc:240] Negotiation successful
0924 12:56:50.205323 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1219,"mutex_wait_us":97,"thread_start_us":633,"threads_started":1}
I20260924 12:56:50.207211 27274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e102efb86e8434e8339f35a7c04b8fb" candidate_uuid: "9c8e582db64d4578842f5c508e24255c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" is_pre_election: true
I20260924 12:56:50.207821 27274 raft_consensus.cc:2454] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8e582db64d4578842f5c508e24255c in term 0.
I20260924 12:56:50.207715 27140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e102efb86e8434e8339f35a7c04b8fb" candidate_uuid: "9c8e582db64d4578842f5c508e24255c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cccc2a7614844c82ae3d15a15edded1a" is_pre_election: true
I20260924 12:56:50.208524 27140 raft_consensus.cc:2454] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8e582db64d4578842f5c508e24255c in term 0.
I20260924 12:56:50.208727 27342 leader_election.cc:302] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c8e582db64d4578842f5c508e24255c, cbb5fcac28ab4db5aaa48f041c7a69cb; no voters:
I20260924 12:56:50.209358 27478 raft_consensus.cc:2781] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:56:50.209546 27478 raft_consensus.cc:482] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:56:50.209690 27478 raft_consensus.cc:3037] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:50.212034 27478 raft_consensus.cc:504] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } } peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } }
I20260924 12:56:50.212910 27478 leader_election.cc:288] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [CANDIDATE]: Term 1 election: Requested vote from peers cccc2a7614844c82ae3d15a15edded1a (127.11.49.65:36931), cbb5fcac28ab4db5aaa48f041c7a69cb (127.11.49.66:44419)
I20260924 12:56:50.213758 27274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e102efb86e8434e8339f35a7c04b8fb" candidate_uuid: "9c8e582db64d4578842f5c508e24255c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb"
I20260924 12:56:50.213765 27140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e102efb86e8434e8339f35a7c04b8fb" candidate_uuid: "9c8e582db64d4578842f5c508e24255c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cccc2a7614844c82ae3d15a15edded1a"
I20260924 12:56:50.213999 27274 raft_consensus.cc:3037] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:50.214123 27140 raft_consensus.cc:3037] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:56:50.216634 27274 raft_consensus.cc:2454] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8e582db64d4578842f5c508e24255c in term 1.
I20260924 12:56:50.217170 27342 leader_election.cc:302] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c8e582db64d4578842f5c508e24255c, cbb5fcac28ab4db5aaa48f041c7a69cb; no voters:
I20260924 12:56:50.217244 27140 raft_consensus.cc:2454] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8e582db64d4578842f5c508e24255c in term 1.
I20260924 12:56:50.217643 27478 raft_consensus.cc:2781] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:56:50.218258 27478 raft_consensus.cc:686] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 1 LEADER]: Becoming Leader. State: Replica: 9c8e582db64d4578842f5c508e24255c, State: Running, Role: LEADER
I20260924 12:56:50.218901 27478 consensus_queue.cc:237] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } } peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } }
I20260924 12:56:50.225459 26995 catalog_manager.cc:5495] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c8e582db64d4578842f5c508e24255c (127.11.49.67). New cstate: current_term: 1 leader_uuid: "9c8e582db64d4578842f5c508e24255c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } health_report { overall_health: UNKNOWN } } }
W20260924 12:56:50.233006 27454 tablet.cc:2369] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:56:50.255322 27471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.248687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51512 (local address 127.11.49.67:46061)
0924 12:56:50.248990 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:50.248998 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:50.249211 (+ 213us) server_negotiation.cc:407] Connection header received
0924 12:56:50.249533 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:50.249537 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:50.249638 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:50.249862 (+ 224us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:56:50.250288 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.251060 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.252749 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.253251 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.253403 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.254079 (+ 676us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:56:50.254640 (+ 561us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:56:50.254803 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:50.254936 (+ 133us) server_negotiation.cc:299] Negotiation successful
0924 12:56:50.255035 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260924 12:56:50.266732 27274 raft_consensus.cc:1261] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb [term 1 FOLLOWER]: Refusing update from remote peer 9c8e582db64d4578842f5c508e24255c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:56:50.266732 27140 raft_consensus.cc:1261] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a [term 1 FOLLOWER]: Refusing update from remote peer 9c8e582db64d4578842f5c508e24255c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:56:50.268242 27482 consensus_queue.cc:1035] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:56:50.268882 27478 consensus_queue.cc:1035] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:56:50.287986 27487 mvcc.cc:205] Tried to move back new op lower bound from 7332882883638067200 to 7332882883461550080. Current Snapshot: MvccSnapshot[applied={T|T < 7332882883638067200}]
I20260924 12:56:50.317302 26995 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:56:50.317791 26995 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:56:50.323630 26995 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Sending DeleteTablet for 3 replicas of tablet 0e102efb86e8434e8339f35a7c04b8fb
I20260924 12:56:50.325728 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 27057
I20260924 12:56:50.325573 27120 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e102efb86e8434e8339f35a7c04b8fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:50 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:57412
I20260924 12:56:50.325935 27254 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e102efb86e8434e8339f35a7c04b8fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:50 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:43966
I20260924 12:56:50.326749 27388 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e102efb86e8434e8339f35a7c04b8fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:56:50 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:51504
I20260924 12:56:50.337037 27498 tablet_replica.cc:330] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: stopping tablet replica
I20260924 12:56:50.337620 27495 tablet_replica.cc:330] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a: stopping tablet replica
I20260924 12:56:50.338214 27495 raft_consensus.cc:2229] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:56:50.338999 27495 raft_consensus.cc:2258] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:50.339556 27498 raft_consensus.cc:2229] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:56:50.340098 27496 tablet_replica.cc:330] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb: stopping tablet replica
I20260924 12:56:50.340884 27496 raft_consensus.cc:2229] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:56:50.341106 27498 raft_consensus.cc:2258] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:50.341661 27496 raft_consensus.cc:2258] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:56:50.343731 27495 ts_tablet_manager.cc:1905] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:50.343858 27498 ts_tablet_manager.cc:1905] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:50.353300 27495 ts_tablet_manager.cc:1918] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:50.353609 27496 ts_tablet_manager.cc:1905] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:56:50.353786 27495 log.cc:1196] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/0e102efb86e8434e8339f35a7c04b8fb
I20260924 12:56:50.354321 27498 ts_tablet_manager.cc:1918] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:50.354609 27498 log.cc:1196] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/0e102efb86e8434e8339f35a7c04b8fb
I20260924 12:56:50.354652 27495 ts_tablet_manager.cc:1939] T 0e102efb86e8434e8339f35a7c04b8fb P cccc2a7614844c82ae3d15a15edded1a: Deleting consensus metadata
I20260924 12:56:50.355330 27498 ts_tablet_manager.cc:1939] T 0e102efb86e8434e8339f35a7c04b8fb P 9c8e582db64d4578842f5c508e24255c: Deleting consensus metadata
I20260924 12:56:50.357623 26983 catalog_manager.cc:4841] TS 9c8e582db64d4578842f5c508e24255c (127.11.49.67:46061): tablet 0e102efb86e8434e8339f35a7c04b8fb (table test-table [id=8499bfd0bdfa4c04b514a0d3ee3f78c5]) successfully deleted
I20260924 12:56:50.358117 26983 catalog_manager.cc:4841] TS cccc2a7614844c82ae3d15a15edded1a (127.11.49.65:36931): tablet 0e102efb86e8434e8339f35a7c04b8fb (table test-table [id=8499bfd0bdfa4c04b514a0d3ee3f78c5]) successfully deleted
I20260924 12:56:50.361352 27496 ts_tablet_manager.cc:1918] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:56:50.361605 27496 log.cc:1196] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/0e102efb86e8434e8339f35a7c04b8fb
Sep 24 12:56:50 dist-test-slave-m9hg krb5kdc[26951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:56:50.362227 27496 ts_tablet_manager.cc:1939] T 0e102efb86e8434e8339f35a7c04b8fb P cbb5fcac28ab4db5aaa48f041c7a69cb: Deleting consensus metadata
I20260924 12:56:50.364689 26981 catalog_manager.cc:4841] TS cbb5fcac28ab4db5aaa48f041c7a69cb (127.11.49.66:44419): tablet 0e102efb86e8434e8339f35a7c04b8fb (table test-table [id=8499bfd0bdfa4c04b514a0d3ee3f78c5]) successfully deleted
I20260924 12:56:50.372573 27467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.327390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57418 (local address 127.11.49.65:36931)
0924 12:56:50.327691 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:50.327702 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:50.338538 (+ 10836us) server_negotiation.cc:407] Connection header received
0924 12:56:50.338803 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:50.338809 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:50.338935 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:50.339125 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:50.344457 (+ 5332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.345693 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.348562 (+ 2869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.349279 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.349418 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.363652 (+ 14234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:50.363681 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:50.363707 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:50.363773 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:50.368128 (+ 4355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:50.369417 (+ 1289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:50.369427 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:50.369430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:50.369665 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:50.370282 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:50.370287 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:50.370289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:50.370843 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:50.371569 (+ 726us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:50.371778 (+ 209us) server_negotiation.cc:299] Negotiation successful
0924 12:56:50.372084 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260924 12:56:50.373639 27180 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:50.478543 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 27057
I20260924 12:56:50.501817 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 27191
Sep 24 12:56:50 dist-test-slave-m9hg krb5kdc[26951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:56:50.525823 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.503024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43982 (local address 127.11.49.66:44419)
0924 12:56:50.503233 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:50.503239 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:50.503270 (+ 31us) server_negotiation.cc:407] Connection header received
0924 12:56:50.503593 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:50.503599 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:50.503691 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:50.503818 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:50.505817 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.506832 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.509393 (+ 2561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.509917 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.510072 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.516698 (+ 6626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:50.516724 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:50.516746 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:50.516810 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:50.521254 (+ 4444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:50.522833 (+ 1579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:50.522845 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:50.522851 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:50.523061 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:50.523599 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:50.523605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:50.523609 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:50.524213 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:50.524643 (+ 430us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:50.525056 (+ 413us) server_negotiation.cc:299] Negotiation successful
0924 12:56:50.525360 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260924 12:56:50.526939 27314 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:50.637878 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 27191
I20260924 12:56:50.657801 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 27325
Sep 24 12:56:50 dist-test-slave-m9hg krb5kdc[26951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:56:50.678117 27471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:56:50.658790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51516 (local address 127.11.49.67:46061)
0924 12:56:50.658973 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0924 12:56:50.658979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:56:50.659092 (+ 113us) server_negotiation.cc:407] Connection header received
0924 12:56:50.659363 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:56:50.659367 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:56:50.659436 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:56:50.659552 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:56:50.661145 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.662073 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.663562 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:56:50.664034 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:56:50.664198 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:56:50.669807 (+ 5609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:56:50.669826 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:56:50.669854 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:56:50.669916 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:56:50.674076 (+ 4160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:50.675491 (+ 1415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:50.675503 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:50.675512 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:50.675771 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:56:50.676414 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:56:50.676417 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:56:50.676419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:56:50.676824 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:56:50.677105 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0924 12:56:50.677591 (+ 486us) server_negotiation.cc:299] Negotiation successful
0924 12:56:50.677802 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260924 12:56:50.679438 27448 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:50.813350 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 27325
I20260924 12:56:50.836364 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 26964
I20260924 12:56:50.838083 27026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:56:50.960124 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 26964
I20260924 12:57:10.986548 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42479
--webserver_interface=127.11.49.126
--webserver_port=34643
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:42479
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:57:11.422842 27503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:11.423276 27503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:11.423462 27503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:11.432487 27503 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260924 12:57:11.432641 27503 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260924 12:57:11.432721 27503 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260924 12:57:11.432806 27503 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:57:11.432922 27503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:11.433059 27503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:11.433126 27503 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:57:11.433182 27503 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:57:11.445962 27503 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:42479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=34643
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:11.447897 27503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:11.449925 27503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:11.480999 27512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:11.481694 27503 server_base.cc:1034] running on GCE node
W20260924 12:57:11.481065 27510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:11.481122 27509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:11.483280 27503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:11.485198 27503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:11.486500 27503 hybrid_clock.cc:648] HybridClock initialized: now 1790254631486406 us; error 70 us; skew 500 ppm
I20260924 12:57:11.487092 27503 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:11 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254631, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:11.491568 27503 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:57:11.493780 27503 webserver.cc:460] Webserver started at http://127.11.49.126:34643/ using document root <none> and password file <none>
I20260924 12:57:11.494673 27503 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:11.494832 27503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:11.502038 27503 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260924 12:57:11.506140 27519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:11.508006 27503 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:57:11.508302 27503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "5baa77c315ff4094ba71dc9d2541850a"
format_stamp: "Formatted at 2026-09-24 12:56:47 on dist-test-slave-m9hg"
server_key: "7955682a4b94944471208fe6d3b415f6"
server_key_iv: "dcc58e0951f6ae32bd9dbee5b819d57c"
server_key_version: "encryptionkey@0"
I20260924 12:57:11.509554 27503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:11.529835 27503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:11.534878 27503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:11.535199 27503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:11.557724 27503 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:42479
I20260924 12:57:11.557830 27570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:42479 every 8 connection(s)
I20260924 12:57:11.559510 27503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:57:11.569211 27571 sys_catalog.cc:263] Verifying existing consensus state
I20260924 12:57:11.570272 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 27503
I20260924 12:57:11.571455 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:36931
--local_ip_for_outbound_sockets=127.11.49.65
--tserver_master_addrs=127.11.49.126:42479
--webserver_port=38789
--webserver_interface=127.11.49.65
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:57:11.576362 27571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Bootstrap starting.
I20260924 12:57:11.607412 27571 log.cc:824] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:57:11.623750 27571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 12:57:11.624572 27571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Bootstrap complete.
I20260924 12:57:11.636130 27571 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:57:11.637346 27571 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5baa77c315ff4094ba71dc9d2541850a, State: Initialized, Role: FOLLOWER
I20260924 12:57:11.638315 27571 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:57:11.638635 27571 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:57:11.638788 27571 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:57:11.639020 27571 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 1 FOLLOWER]: Advancing to term 2
I20260924 12:57:11.644098 27571 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:57:11.644999 27571 leader_election.cc:302] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5baa77c315ff4094ba71dc9d2541850a; no voters:
I20260924 12:57:11.645871 27571 leader_election.cc:288] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260924 12:57:11.646193 27575 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 2 FOLLOWER]: Leader election won for term 2
I20260924 12:57:11.647753 27575 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 2 LEADER]: Becoming Leader. State: Replica: 5baa77c315ff4094ba71dc9d2541850a, State: Running, Role: LEADER
I20260924 12:57:11.648551 27575 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:57:11.649165 27571 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:57:11.651769 27577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5baa77c315ff4094ba71dc9d2541850a. Latest consensus state: current_term: 2 leader_uuid: "5baa77c315ff4094ba71dc9d2541850a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } } }
I20260924 12:57:11.652328 27577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: This master's current role is: LEADER
I20260924 12:57:11.651966 27576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5baa77c315ff4094ba71dc9d2541850a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } } }
I20260924 12:57:11.652567 27576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: This master's current role is: LEADER
I20260924 12:57:11.663617 27582 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:57:11.676543 27582 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:57:11.680538 27582 catalog_manager.cc:1259] Loaded cluster ID: 3e2b6812080648a4bd1d7a80af1a58d6
I20260924 12:57:11.680914 27582 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:57:11.687980 27582 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:57:11.697714 27582 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Loaded TSK: 0
I20260924 12:57:11.732892 27582 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Generated new TSK 1
I20260924 12:57:11.733534 27582 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260924 12:57:11.968505 27573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:11.968856 27573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:11.969022 27573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:11.976752 27573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:11.976924 27573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:11.977106 27573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:57:11.987329 27573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:36931
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=38789
--tserver_master_addrs=127.11.49.126:42479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:11.988814 27573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:11.990170 27573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:12.008915 27599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:12.009063 27598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:12.012230 27601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:12.014585 27573 server_base.cc:1034] running on GCE node
I20260924 12:57:12.015982 27573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:12.018029 27573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:12.019562 27573 hybrid_clock.cc:648] HybridClock initialized: now 1790254632019458 us; error 112 us; skew 500 ppm
I20260924 12:57:12.020162 27573 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:12 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:12.025876 27573 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:57:12.028779 27573 webserver.cc:460] Webserver started at http://127.11.49.65:38789/ using document root <none> and password file <none>
I20260924 12:57:12.030294 27573 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:12.030539 27573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:12.040562 27573 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.001s sys 0.005s
I20260924 12:57:12.044070 27608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:12.046005 27573 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:57:12.046244 27573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "cccc2a7614844c82ae3d15a15edded1a"
format_stamp: "Formatted at 2026-09-24 12:56:48 on dist-test-slave-m9hg"
server_key: "a2ee7f17c1d5e59d28e1b4d8b14a4bc3"
server_key_iv: "c906584fb96a3d74d1cff415563b6ba7"
server_key_version: "encryptionkey@0"
I20260924 12:57:12.047364 27573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:12.075289 27573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:12.080974 27573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:12.081291 27573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:12.082468 27573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:57:12.084002 27573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:57:12.084129 27573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:12.084312 27573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:57:12.084417 27573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260924 12:57:12.127795 27573 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:36931
I20260924 12:57:12.127904 27720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:36931 every 8 connection(s)
I20260924 12:57:12.129395 27573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:57:12.131199 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 27573
I20260924 12:57:12.132076 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:44419
--local_ip_for_outbound_sockets=127.11.49.66
--tserver_master_addrs=127.11.49.126:42479
--webserver_port=41727
--webserver_interface=127.11.49.66
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:57:12 dist-test-slave-m9hg krb5kdc[26951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:57:12.160154 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:12.133698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:56347)
0924 12:57:12.134879 (+ 1181us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:12.134938 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:12.137175 (+ 2237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:12.138931 (+ 1756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:12.138945 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:12.139701 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:57:12.140434 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:12.140459 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:12.142640 (+ 2181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:12.142645 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:12.144082 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:12.144100 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:12.145388 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:12.145396 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:12.145724 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:12.146591 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:57:12.146619 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:57:12.149797 (+ 3178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:57:12.154531 (+ 4734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:12.154543 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:12.154565 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:12.155132 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:12.155672 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:12.155680 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:12.155686 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:12.155946 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:12.157440 (+ 1494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:57:12.157447 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:57:12.157882 (+ 435us) client_negotiation.cc:769] Sending connection context
0924 12:57:12.158216 (+ 334us) client_negotiation.cc:240] Negotiation successful
0924 12:57:12.158765 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"thread_start_us":610,"threads_started":1}
I20260924 12:57:12.160527 27723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:12.133570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:56347 (local address 127.11.49.126:42479)
0924 12:57:12.134360 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:12.134382 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:12.135119 (+ 737us) server_negotiation.cc:407] Connection header received
0924 12:57:12.137880 (+ 2761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:12.137893 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:12.138343 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:12.138766 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:12.140891 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:12.142374 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:12.144312 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:12.145065 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:12.145326 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:12.150276 (+ 4950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:12.150288 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:12.150307 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:12.150360 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:12.154280 (+ 3920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:12.155321 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:12.155329 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:12.155334 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:12.155534 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:12.156293 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:12.156306 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:12.156312 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:12.157237 (+ 925us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:12.157514 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:12.158532 (+ 1018us) server_negotiation.cc:299] Negotiation successful
0924 12:57:12.159078 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":348,"threads_started":1}
I20260924 12:57:12.163905 27721 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42479
I20260924 12:57:12.164383 27721 heartbeater.cc:464] Registering TS with master...
I20260924 12:57:12.165331 27721 heartbeater.cc:511] Master 127.11.49.126:42479 requested a full tablet report, sending...
I20260924 12:57:12.169083 27536 ts_manager.cc:194] Registered new tserver with Master: cccc2a7614844c82ae3d15a15edded1a (127.11.49.65:36931)
I20260924 12:57:12.171582 27536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:56347
W20260924 12:57:12.476472 27725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:12.476769 27725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:12.476922 27725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:12.484442 27725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:12.484571 27725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:12.484759 27725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:57:12.495348 27725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:44419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=41727
--tserver_master_addrs=127.11.49.126:42479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:12.496770 27725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:12.498070 27725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:12.513211 27730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:12.513465 27733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:12.513396 27731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:12.514705 27725 server_base.cc:1034] running on GCE node
I20260924 12:57:12.515475 27725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:12.516721 27725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:12.518114 27725 hybrid_clock.cc:648] HybridClock initialized: now 1790254632518031 us; error 66 us; skew 500 ppm
I20260924 12:57:12.518517 27725 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:12 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:12.525585 27725 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:57:12.527570 27725 webserver.cc:460] Webserver started at http://127.11.49.66:41727/ using document root <none> and password file <none>
I20260924 12:57:12.528451 27725 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:12.528589 27725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:12.535032 27725 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260924 12:57:12.538679 27740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:12.540594 27725 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:57:12.540824 27725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb"
format_stamp: "Formatted at 2026-09-24 12:56:49 on dist-test-slave-m9hg"
server_key: "8eb1ce569b7be37bec08e5184b70093e"
server_key_iv: "c3a56bbab13eb2edfcb081097362d8f2"
server_key_version: "encryptionkey@0"
I20260924 12:57:12.541922 27725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:12.562081 27725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:12.567059 27725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:12.567366 27725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:12.568529 27725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:57:12.570181 27725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:57:12.570330 27725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:12.570465 27725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:57:12.570549 27725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:12.622448 27725 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:44419
I20260924 12:57:12.622567 27852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:44419 every 8 connection(s)
I20260924 12:57:12.624114 27725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:57:12.631906 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 27725
I20260924 12:57:12.632807 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:46061
--local_ip_for_outbound_sockets=127.11.49.67
--tserver_master_addrs=127.11.49.126:42479
--webserver_port=38995
--webserver_interface=127.11.49.67
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 12:57:12 dist-test-slave-m9hg krb5kdc[26951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:57:12.656229 27723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:12.627995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:45725 (local address 127.11.49.126:42479)
0924 12:57:12.628317 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:12.628325 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:12.630099 (+ 1774us) server_negotiation.cc:407] Connection header received
0924 12:57:12.635135 (+ 5036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:12.635147 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:12.635314 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:12.635402 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:12.638223 (+ 2821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:12.639063 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:12.641802 (+ 2739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:12.642465 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:12.642666 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:12.647534 (+ 4868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:12.647546 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:12.647555 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:12.647626 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:12.652086 (+ 4460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:12.653147 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:12.653156 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:12.653163 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:12.653368 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:12.653843 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:12.653851 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:12.653857 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:12.654352 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:12.654528 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:12.655352 (+ 824us) server_negotiation.cc:299] Negotiation successful
0924 12:57:12.655708 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260924 12:57:12.656967 27855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:12.628718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:45725)
0924 12:57:12.629855 (+ 1137us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:12.629940 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:12.634493 (+ 4553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:12.636355 (+ 1862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:12.636371 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:12.637117 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:57:12.637945 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:12.637975 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:12.639266 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:12.639272 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:12.641453 (+ 2181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:12.641489 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:12.643125 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:12.643135 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:12.643579 (+ 444us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:12.644489 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:57:12.644523 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:57:12.647091 (+ 2568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:57:12.652368 (+ 5277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:12.652377 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:12.652392 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:12.652938 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:12.653499 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:12.653502 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:12.653505 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:12.653704 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:12.654508 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:57:12.654514 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:57:12.654922 (+ 408us) client_negotiation.cc:769] Sending connection context
0924 12:57:12.655172 (+ 250us) client_negotiation.cc:240] Negotiation successful
0924 12:57:12.655622 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":420,"threads_started":1}
I20260924 12:57:12.658891 27853 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42479
I20260924 12:57:12.659242 27853 heartbeater.cc:464] Registering TS with master...
I20260924 12:57:12.660043 27853 heartbeater.cc:511] Master 127.11.49.126:42479 requested a full tablet report, sending...
I20260924 12:57:12.661898 27536 ts_manager.cc:194] Registered new tserver with Master: cbb5fcac28ab4db5aaa48f041c7a69cb (127.11.49.66:44419)
I20260924 12:57:12.662789 27536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:45725
W20260924 12:57:13.059613 27856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:13.060114 27856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:13.060390 27856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:13.070088 27856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:13.070317 27856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:13.070580 27856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:57:13.083500 27856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:46061
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=38995
--tserver_master_addrs=127.11.49.126:42479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:13.085407 27856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:13.087172 27856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:13.104959 27862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:13.105039 27864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:13.105064 27861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:13.105420 27856 server_base.cc:1034] running on GCE node
I20260924 12:57:13.106508 27856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:13.108126 27856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:13.109414 27856 hybrid_clock.cc:648] HybridClock initialized: now 1790254633109320 us; error 78 us; skew 500 ppm
I20260924 12:57:13.109869 27856 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:13 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254633, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:13.114215 27856 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:57:13.116477 27856 webserver.cc:460] Webserver started at http://127.11.49.67:38995/ using document root <none> and password file <none>
I20260924 12:57:13.117690 27856 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:13.117935 27856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:13.126194 27856 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260924 12:57:13.131004 27871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:13.133397 27856 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260924 12:57:13.133671 27856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "9c8e582db64d4578842f5c508e24255c"
format_stamp: "Formatted at 2026-09-24 12:56:49 on dist-test-slave-m9hg"
server_key: "ec95e2d2ad4cc72a0025bb79d98b768c"
server_key_iv: "1d6713f7953b9a82160d1eef1fe9174d"
server_key_version: "encryptionkey@0"
I20260924 12:57:13.135208 27856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:13.156406 27856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:13.162796 27856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:13.163111 27856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:13.164551 27856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:57:13.166549 27856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:57:13.166666 27856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:13.166769 27856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:57:13.166833 27856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:13.175700 27721 heartbeater.cc:503] Master 127.11.49.126:42479 was elected leader, sending a full tablet report...
I20260924 12:57:13.209064 27856 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:46061
I20260924 12:57:13.209165 27983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:46061 every 8 connection(s)
I20260924 12:57:13.210999 27856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:57:13.220767 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 27856
Sep 24 12:57:13 dist-test-slave-m9hg krb5kdc[26951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254633, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:57:13.237102 27986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.214438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:43685 (local address 127.11.49.126:42479)
0924 12:57:13.214968 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.214974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.216327 (+ 1353us) server_negotiation.cc:407] Connection header received
0924 12:57:13.218479 (+ 2152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.218484 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.218587 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.218715 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:13.220504 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.221325 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.223819 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.224253 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.224444 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.229229 (+ 4785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:13.229240 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:13.229244 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:13.229279 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:13.232552 (+ 3273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.233518 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.233522 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.233525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.233679 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.234322 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.234332 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.234338 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.234918 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:13.235129 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.236218 (+ 1089us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.236591 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":254,"threads_started":1}
I20260924 12:57:13.237810 27987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.215157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:43685)
0924 12:57:13.216103 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:13.216151 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:13.218166 (+ 2015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:13.218992 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:13.219001 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:13.219572 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:57:13.220239 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.220257 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.221519 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.221525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.223661 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.223676 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.224546 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.224555 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.224834 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.225748 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:57:13.225785 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:57:13.228967 (+ 3182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:57:13.232738 (+ 3771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:13.232748 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:13.232768 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:13.233356 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:13.233821 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:13.233827 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:13.233830 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:13.234126 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:13.235113 (+ 987us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:57:13.235119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:57:13.235674 (+ 555us) client_negotiation.cc:769] Sending connection context
0924 12:57:13.235984 (+ 310us) client_negotiation.cc:240] Negotiation successful
0924 12:57:13.236568 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":380,"threads_started":1}
I20260924 12:57:13.240018 27984 heartbeater.cc:347] Connected to a master server at 127.11.49.126:42479
I20260924 12:57:13.240619 27984 heartbeater.cc:464] Registering TS with master...
I20260924 12:57:13.241421 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.222281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54214 (local address 127.11.49.126:42479)
0924 12:57:13.223092 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.223097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.223119 (+ 22us) server_negotiation.cc:407] Connection header received
0924 12:57:13.223270 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.223277 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.223356 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.223496 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:13.225610 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.226791 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.229090 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.229638 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.229815 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.233203 (+ 3388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:13.233210 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:13.233213 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:13.233260 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:13.237444 (+ 4184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.238616 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.238621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.238624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.238833 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.239442 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.239447 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.239450 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.239869 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:13.240231 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.240739 (+ 508us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.241037 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":450,"threads_started":1}
I20260924 12:57:13.241919 27984 heartbeater.cc:511] Master 127.11.49.126:42479 requested a full tablet report, sending...
I20260924 12:57:13.244081 27535 ts_manager.cc:194] Registered new tserver with Master: 9c8e582db64d4578842f5c508e24255c (127.11.49.67:46061)
I20260924 12:57:13.245283 27535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:43685
I20260924 12:57:13.258649 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:57:13.267028 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.259914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54220 (local address 127.11.49.126:42479)
0924 12:57:13.260160 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.260167 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.260708 (+ 541us) server_negotiation.cc:407] Connection header received
0924 12:57:13.260954 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.260959 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.261161 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.261343 (+ 182us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:57:13.261842 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.262672 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.264550 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.265203 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.265381 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.265996 (+ 615us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:57:13.266274 (+ 278us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0924 12:57:13.266693 (+ 419us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54220: token expired
Metrics: {"server-negotiator.queue_time_us":87}
W20260924 12:57:13.267251 27989 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54220: token expired
W20260924 12:57:13.267637 27457 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.49.126:42479)
I20260924 12:57:13.283352 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.268341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54230 (local address 127.11.49.126:42479)
0924 12:57:13.268567 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.268571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.268591 (+ 20us) server_negotiation.cc:407] Connection header received
0924 12:57:13.268649 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.268653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.268735 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.268843 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:13.270543 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.271516 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.273133 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.273581 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.273697 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.276638 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:13.276643 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:13.276647 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:13.276695 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:13.279942 (+ 3247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.281020 (+ 1078us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.281026 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.281029 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.281253 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.281713 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.281717 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.281719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.282184 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:13.282476 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.282832 (+ 356us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.283060 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260924 12:57:13.287297 27535 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54230:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:57:13.295394 27535 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:57:13.335596 27996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.310530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36320 (local address 127.11.49.66:44419)
0924 12:57:13.325109 (+ 14579us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.325122 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.325174 (+ 52us) server_negotiation.cc:407] Connection header received
0924 12:57:13.325407 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.325416 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.325724 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.325948 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:57:13.327139 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.329494 (+ 2355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.332496 (+ 3002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.334075 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.334229 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.334454 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.335009 (+ 555us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.335200 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14260,"thread_start_us":14087,"threads_started":1}
I20260924 12:57:13.335971 27995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.310334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:44419 (local address 127.0.0.1:36320)
0924 12:57:13.323351 (+ 13017us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:13.323440 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:13.323792 (+ 352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:13.326267 (+ 2475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:13.326277 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:13.326314 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:57:13.326882 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.326900 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.329749 (+ 2849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.329760 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.332200 (+ 2440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.332225 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.334375 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.334382 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.334632 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.334734 (+ 102us) client_negotiation.cc:769] Sending connection context
0924 12:57:13.334934 (+ 200us) client_negotiation.cc:240] Negotiation successful
0924 12:57:13.335331 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12616,"mutex_wait_us":97,"thread_start_us":12437,"threads_started":1}
I20260924 12:57:13.337314 27997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.310594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36931 (local address 127.0.0.1:60566)
0924 12:57:13.325584 (+ 14990us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:13.325608 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:13.325780 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:13.327976 (+ 2196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:13.327981 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:13.328014 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:57:13.328518 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.328531 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.330738 (+ 2207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.330744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.333414 (+ 2670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.333430 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.336207 (+ 2777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.336214 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.336485 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.336527 (+ 42us) client_negotiation.cc:769] Sending connection context
0924 12:57:13.336668 (+ 141us) client_negotiation.cc:240] Negotiation successful
0924 12:57:13.336838 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14846,"mutex_wait_us":118,"thread_start_us":14547,"threads_started":1}
I20260924 12:57:13.337364 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.310950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60566 (local address 127.11.49.65:36931)
0924 12:57:13.323173 (+ 12223us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.323185 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.325929 (+ 2744us) server_negotiation.cc:407] Connection header received
0924 12:57:13.326312 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.326324 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.326738 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.327050 (+ 312us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:57:13.328767 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.330542 (+ 1775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.333674 (+ 3132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.335524 (+ 1850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.335711 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.336011 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.336747 (+ 736us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.337001 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11952,"thread_start_us":13106,"threads_started":1}
I20260924 12:57:13.340775 27788 tablet_service.cc:1467] Processing CreateTablet for tablet 33722d6d9bc141cca31691e84e1ea0dd (DEFAULT_TABLE table=test-table [id=a75f9608a417403f97201c2ab8d9d660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:57:13.341565 28000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.326199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50626 (local address 127.11.49.67:46061)
0924 12:57:13.330831 (+ 4632us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.330844 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.330893 (+ 49us) server_negotiation.cc:407] Connection header received
0924 12:57:13.331050 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.331062 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.331437 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.331718 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:57:13.332743 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.334439 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.337326 (+ 2887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.340016 (+ 2690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.340171 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.340449 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.341022 (+ 573us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.341196 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4395,"thread_start_us":4151,"threads_started":1}
I20260924 12:57:13.341616 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.326105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:46061 (local address 127.0.0.1:50626)
0924 12:57:13.329818 (+ 3713us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:13.329842 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:13.330002 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:13.331756 (+ 1754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:13.331764 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:13.331808 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:57:13.332483 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.332495 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.334668 (+ 2173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.334677 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.337083 (+ 2406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.337103 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.340375 (+ 3272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.340388 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.340722 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.340793 (+ 71us) client_negotiation.cc:769] Sending connection context
0924 12:57:13.340903 (+ 110us) client_negotiation.cc:240] Negotiation successful
0924 12:57:13.341146 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3510,"mutex_wait_us":100,"thread_start_us":1458,"threads_started":1}
I20260924 12:57:13.342689 27788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33722d6d9bc141cca31691e84e1ea0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:57:13.344210 27656 tablet_service.cc:1467] Processing CreateTablet for tablet 33722d6d9bc141cca31691e84e1ea0dd (DEFAULT_TABLE table=test-table [id=a75f9608a417403f97201c2ab8d9d660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:57:13.345702 27919 tablet_service.cc:1467] Processing CreateTablet for tablet 33722d6d9bc141cca31691e84e1ea0dd (DEFAULT_TABLE table=test-table [id=a75f9608a417403f97201c2ab8d9d660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:57:13.346415 27656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33722d6d9bc141cca31691e84e1ea0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:57:13.347242 27919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33722d6d9bc141cca31691e84e1ea0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:57:13.362061 28001 tablet_bootstrap.cc:492] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: Bootstrap starting.
I20260924 12:57:13.364612 28002 tablet_bootstrap.cc:492] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a: Bootstrap starting.
I20260924 12:57:13.365511 28003 tablet_bootstrap.cc:492] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: Bootstrap starting.
I20260924 12:57:13.367030 28001 tablet_bootstrap.cc:654] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: Neither blocks nor log segments found. Creating new log.
I20260924 12:57:13.368777 28001 log.cc:824] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: Log is configured to *not* fsync() on all Append() calls
I20260924 12:57:13.368862 28003 tablet_bootstrap.cc:654] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: Neither blocks nor log segments found. Creating new log.
I20260924 12:57:13.370147 28002 tablet_bootstrap.cc:654] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a: Neither blocks nor log segments found. Creating new log.
I20260924 12:57:13.371021 28003 log.cc:824] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: Log is configured to *not* fsync() on all Append() calls
I20260924 12:57:13.371608 28002 log.cc:824] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:57:13.373242 28001 tablet_bootstrap.cc:492] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: No bootstrap required, opened a new log
I20260924 12:57:13.373656 28001 ts_tablet_manager.cc:1397] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260924 12:57:13.374109 28003 tablet_bootstrap.cc:492] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: No bootstrap required, opened a new log
I20260924 12:57:13.374398 28003 ts_tablet_manager.cc:1397] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260924 12:57:13.375366 28002 tablet_bootstrap.cc:492] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a: No bootstrap required, opened a new log
I20260924 12:57:13.375717 28002 ts_tablet_manager.cc:1397] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.001s
I20260924 12:57:13.382344 28003 raft_consensus.cc:348] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } } peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } }
I20260924 12:57:13.382803 28003 raft_consensus.cc:374] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:57:13.382920 28003 raft_consensus.cc:729] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8e582db64d4578842f5c508e24255c, State: Initialized, Role: FOLLOWER
I20260924 12:57:13.383559 28003 consensus_queue.cc:260] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } } peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } }
I20260924 12:57:13.384908 27984 heartbeater.cc:503] Master 127.11.49.126:42479 was elected leader, sending a full tablet report...
I20260924 12:57:13.385339 28003 ts_tablet_manager.cc:1428] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: Time spent starting tablet: real 0.011s user 0.007s sys 0.005s
I20260924 12:57:13.385761 28001 raft_consensus.cc:348] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } } peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } }
I20260924 12:57:13.386320 28001 raft_consensus.cc:374] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:57:13.386444 28001 raft_consensus.cc:729] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb5fcac28ab4db5aaa48f041c7a69cb, State: Initialized, Role: FOLLOWER
I20260924 12:57:13.387200 28001 consensus_queue.cc:260] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } } peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } }
I20260924 12:57:13.388767 27853 heartbeater.cc:503] Master 127.11.49.126:42479 was elected leader, sending a full tablet report...
I20260924 12:57:13.389626 28001 ts_tablet_manager.cc:1428] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: Time spent starting tablet: real 0.016s user 0.011s sys 0.005s
I20260924 12:57:13.390830 28002 raft_consensus.cc:348] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } } peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } }
I20260924 12:57:13.391456 28002 raft_consensus.cc:374] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:57:13.391665 28002 raft_consensus.cc:729] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cccc2a7614844c82ae3d15a15edded1a, State: Initialized, Role: FOLLOWER
I20260924 12:57:13.392592 28002 consensus_queue.cc:260] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } } peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } }
I20260924 12:57:13.394903 28002 ts_tablet_manager.cc:1428] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a: Time spent starting tablet: real 0.019s user 0.015s sys 0.002s
W20260924 12:57:13.463286 27985 tablet.cc:2369] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:57:13.514453 28009 raft_consensus.cc:482] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:57:13.514854 28009 raft_consensus.cc:504] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } } peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } }
I20260924 12:57:13.517155 28009 leader_election.cc:288] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbb5fcac28ab4db5aaa48f041c7a69cb (127.11.49.66:44419), 9c8e582db64d4578842f5c508e24255c (127.11.49.67:46061)
I20260924 12:57:13.525897 28000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.517703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:53337 (local address 127.11.49.67:46061)
0924 12:57:13.517943 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.517950 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.519186 (+ 1236us) server_negotiation.cc:407] Connection header received
0924 12:57:13.519430 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.519436 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.519551 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.519666 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:57:13.520415 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.521269 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.523513 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.524695 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.524917 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.525013 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.525491 (+ 478us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.525619 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260924 12:57:13.525929 27996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.517815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:59631 (local address 127.11.49.66:44419)
0924 12:57:13.518104 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.518116 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.519063 (+ 947us) server_negotiation.cc:407] Connection header received
0924 12:57:13.519303 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.519312 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.519400 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.519491 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:57:13.520295 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.521071 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.523504 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.524751 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.524961 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.525067 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.525451 (+ 384us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.525603 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260924 12:57:13.526171 28011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.517757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:46061 (local address 127.11.49.65:53337)
0924 12:57:13.519005 (+ 1248us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:13.519031 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:13.519255 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:13.519712 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:13.519716 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:13.519756 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:57:13.520220 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.520236 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.521427 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.521431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.523233 (+ 1802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.523246 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.525110 (+ 1864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.525119 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.525284 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.525310 (+ 26us) client_negotiation.cc:769] Sending connection context
0924 12:57:13.525442 (+ 132us) client_negotiation.cc:240] Negotiation successful
0924 12:57:13.525615 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1066,"mutex_wait_us":91,"thread_start_us":584,"threads_started":1}
I20260924 12:57:13.526216 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.517749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:44419 (local address 127.11.49.65:59631)
0924 12:57:13.518891 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:13.518910 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:13.519095 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:13.519552 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:13.519558 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:13.519588 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:57:13.520093 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.520108 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.521230 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.521235 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.523280 (+ 2045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:13.523299 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.525059 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.525069 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:13.525222 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.525290 (+ 68us) client_negotiation.cc:769] Sending connection context
0924 12:57:13.525385 (+ 95us) client_negotiation.cc:240] Negotiation successful
0924 12:57:13.525582 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":971,"mutex_wait_us":110,"thread_start_us":739,"threads_started":1}
I20260924 12:57:13.527575 27939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33722d6d9bc141cca31691e84e1ea0dd" candidate_uuid: "cccc2a7614844c82ae3d15a15edded1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8e582db64d4578842f5c508e24255c" is_pre_election: true
I20260924 12:57:13.527647 27808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33722d6d9bc141cca31691e84e1ea0dd" candidate_uuid: "cccc2a7614844c82ae3d15a15edded1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" is_pre_election: true
I20260924 12:57:13.528134 27939 raft_consensus.cc:2454] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cccc2a7614844c82ae3d15a15edded1a in term 0.
I20260924 12:57:13.528237 27808 raft_consensus.cc:2454] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cccc2a7614844c82ae3d15a15edded1a in term 0.
I20260924 12:57:13.529011 27612 leader_election.cc:302] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c8e582db64d4578842f5c508e24255c, cccc2a7614844c82ae3d15a15edded1a; no voters:
I20260924 12:57:13.529461 28009 raft_consensus.cc:2781] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:57:13.529624 28009 raft_consensus.cc:482] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:57:13.529747 28009 raft_consensus.cc:3037] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:57:13.532224 28009 raft_consensus.cc:504] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } } peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } }
I20260924 12:57:13.533056 28009 leader_election.cc:288] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [CANDIDATE]: Term 1 election: Requested vote from peers cbb5fcac28ab4db5aaa48f041c7a69cb (127.11.49.66:44419), 9c8e582db64d4578842f5c508e24255c (127.11.49.67:46061)
I20260924 12:57:13.533771 27939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33722d6d9bc141cca31691e84e1ea0dd" candidate_uuid: "cccc2a7614844c82ae3d15a15edded1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8e582db64d4578842f5c508e24255c"
I20260924 12:57:13.533772 27808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33722d6d9bc141cca31691e84e1ea0dd" candidate_uuid: "cccc2a7614844c82ae3d15a15edded1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb"
I20260924 12:57:13.534060 27939 raft_consensus.cc:3037] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:57:13.534096 27808 raft_consensus.cc:3037] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:57:13.538374 27939 raft_consensus.cc:2454] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cccc2a7614844c82ae3d15a15edded1a in term 1.
I20260924 12:57:13.538374 27808 raft_consensus.cc:2454] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cccc2a7614844c82ae3d15a15edded1a in term 1.
I20260924 12:57:13.539214 27610 leader_election.cc:302] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbb5fcac28ab4db5aaa48f041c7a69cb, cccc2a7614844c82ae3d15a15edded1a; no voters:
I20260924 12:57:13.539744 28009 raft_consensus.cc:2781] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:57:13.540470 28009 raft_consensus.cc:686] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 1 LEADER]: Becoming Leader. State: Replica: cccc2a7614844c82ae3d15a15edded1a, State: Running, Role: LEADER
I20260924 12:57:13.541232 28009 consensus_queue.cc:237] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } } peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } }
I20260924 12:57:13.547552 27536 catalog_manager.cc:5495] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a reported cstate change: term changed from 0 to 1, leader changed from <none> to cccc2a7614844c82ae3d15a15edded1a (127.11.49.65). New cstate: current_term: 1 leader_uuid: "cccc2a7614844c82ae3d15a15edded1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cccc2a7614844c82ae3d15a15edded1a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 36931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 } health_report { overall_health: UNKNOWN } } }
I20260924 12:57:13.588516 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.579889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60582 (local address 127.11.49.65:36931)
0924 12:57:13.580205 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.580212 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.580238 (+ 26us) server_negotiation.cc:407] Connection header received
0924 12:57:13.580537 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.580542 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.580654 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.580846 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:57:13.581280 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.582157 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.584907 (+ 2750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.585759 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.585949 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.586835 (+ 886us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:57:13.587667 (+ 832us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:57:13.587871 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.588026 (+ 155us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.588148 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260924 12:57:13.599964 27939 raft_consensus.cc:1261] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c [term 1 FOLLOWER]: Refusing update from remote peer cccc2a7614844c82ae3d15a15edded1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:57:13.599964 27808 raft_consensus.cc:1261] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb [term 1 FOLLOWER]: Refusing update from remote peer cccc2a7614844c82ae3d15a15edded1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:57:13.601462 28009 consensus_queue.cc:1035] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:57:13.601961 28012 consensus_queue.cc:1035] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8e582db64d4578842f5c508e24255c" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:57:13.614257 28016 mvcc.cc:205] Tried to move back new op lower bound from 7332882979210043392 to 7332882978989801472. Current Snapshot: MvccSnapshot[applied={T|T < 7332882979210043392}]
W20260924 12:57:13.627118 27854 tablet.cc:2369] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:57:13.638312 27535 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:57:13.638724 27535 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:57:13.643576 27535 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Sending DeleteTablet for 3 replicas of tablet 33722d6d9bc141cca31691e84e1ea0dd
I20260924 12:57:13.645159 27788 tablet_service.cc:1514] Processing DeleteTablet for tablet 33722d6d9bc141cca31691e84e1ea0dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:57:13 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:36320
I20260924 12:57:13.645274 27656 tablet_service.cc:1514] Processing DeleteTablet for tablet 33722d6d9bc141cca31691e84e1ea0dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:57:13 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:60566
I20260924 12:57:13.646359 27919 tablet_service.cc:1514] Processing DeleteTablet for tablet 33722d6d9bc141cca31691e84e1ea0dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:57:13 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:50626
I20260924 12:57:13.647497 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 27573
I20260924 12:57:13.651654 28025 tablet_replica.cc:330] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: stopping tablet replica
I20260924 12:57:13.652364 28025 raft_consensus.cc:2229] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:57:13.653060 28025 raft_consensus.cc:2258] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:57:13.657598 28027 tablet_replica.cc:330] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: stopping tablet replica
I20260924 12:57:13.658262 28027 raft_consensus.cc:2229] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:57:13.658981 28027 raft_consensus.cc:2258] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:57:13.660013 28026 tablet_replica.cc:330] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a: stopping tablet replica
I20260924 12:57:13.660648 28026 raft_consensus.cc:2229] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:57:13.661494 28026 raft_consensus.cc:2258] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:57:13.661813 28027 ts_tablet_manager.cc:1905] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:57:13.663868 28026 ts_tablet_manager.cc:1905] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:57:13.666419 28025 ts_tablet_manager.cc:1905] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:57:13.672871 28026 ts_tablet_manager.cc:1918] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:57:13.673172 28026 log.cc:1196] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/33722d6d9bc141cca31691e84e1ea0dd
I20260924 12:57:13.674332 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.648566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60588 (local address 127.11.49.65:36931)
0924 12:57:13.648780 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.648787 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.649044 (+ 257us) server_negotiation.cc:407] Connection header received
0924 12:57:13.649319 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.649325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.649421 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.649569 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:13.651957 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.653487 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.656438 (+ 2951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.657333 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.657477 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.664053 (+ 6576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:13.664066 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:13.664083 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:13.664145 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:13.668716 (+ 4571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.669816 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.669831 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.669835 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.670045 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.670552 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.670557 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.670563 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.671217 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:13.672825 (+ 1608us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.673032 (+ 207us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.673772 (+ 740us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260924 12:57:13.675436 27716 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:57:13.675738 28025 ts_tablet_manager.cc:1918] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:57:13.676100 28025 log.cc:1196] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/33722d6d9bc141cca31691e84e1ea0dd
I20260924 12:57:13.676797 28025 ts_tablet_manager.cc:1939] T 33722d6d9bc141cca31691e84e1ea0dd P cbb5fcac28ab4db5aaa48f041c7a69cb: Deleting consensus metadata
I20260924 12:57:13.679491 27521 catalog_manager.cc:4841] TS cbb5fcac28ab4db5aaa48f041c7a69cb (127.11.49.66:44419): tablet 33722d6d9bc141cca31691e84e1ea0dd (table test-table [id=a75f9608a417403f97201c2ab8d9d660]) successfully deleted
I20260924 12:57:13.679627 28027 ts_tablet_manager.cc:1918] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:57:13.679838 28027 log.cc:1196] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/33722d6d9bc141cca31691e84e1ea0dd
I20260924 12:57:13.680653 28027 ts_tablet_manager.cc:1939] T 33722d6d9bc141cca31691e84e1ea0dd P 9c8e582db64d4578842f5c508e24255c: Deleting consensus metadata
I20260924 12:57:13.683738 27523 catalog_manager.cc:4841] TS 9c8e582db64d4578842f5c508e24255c (127.11.49.67:46061): tablet 33722d6d9bc141cca31691e84e1ea0dd (table test-table [id=a75f9608a417403f97201c2ab8d9d660]) successfully deleted
I20260924 12:57:13.792874 28026 ts_tablet_manager.cc:1939] T 33722d6d9bc141cca31691e84e1ea0dd P cccc2a7614844c82ae3d15a15edded1a: Deleting consensus metadata
I20260924 12:57:13.793887 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 27573
I20260924 12:57:13.815222 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 27725
W20260924 12:57:13.815361 27523 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.49.65:36931 (error 108)
I20260924 12:57:13.817618 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.817015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36931 (local address 127.0.0.1:60594)
0924 12:57:13.817245 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:13.817392 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:36931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260924 12:57:13.817975 27523 catalog_manager.cc:4584] TS cccc2a7614844c82ae3d15a15edded1a (127.11.49.65:36931): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 33722d6d9bc141cca31691e84e1ea0dd: Network error: Client connection negotiation failed: client connection to 127.11.49.65:36931: connect: Connection refused (error 111)
I20260924 12:57:13.833295 27996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.816178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36322 (local address 127.11.49.66:44419)
0924 12:57:13.816478 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.816485 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.816517 (+ 32us) server_negotiation.cc:407] Connection header received
0924 12:57:13.816624 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.816628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.816709 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.816874 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:13.818667 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.819598 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.821441 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.822043 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.822186 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.825247 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:13.825270 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:13.825299 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:13.825356 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:13.829532 (+ 4176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.830534 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.830544 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.830547 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.830760 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.831205 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.831210 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.831212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.831786 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:13.832081 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.832498 (+ 417us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.832782 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260924 12:57:13.834355 27848 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:57:13.872079 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.871270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36931 (local address 127.0.0.1:60596)
0924 12:57:13.871650 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:13.871853 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:36931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260924 12:57:13.873487 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.873012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36931 (local address 127.0.0.1:60606)
0924 12:57:13.873197 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:13.873326 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:36931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260924 12:57:13.934870 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.934083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36931 (local address 127.0.0.1:60622)
0924 12:57:13.934515 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:13.934648 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:36931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260924 12:57:13.936211 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.935860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36931 (local address 127.0.0.1:60636)
0924 12:57:13.936010 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:13.936093 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:36931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260924 12:57:13.939460 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 27725
I20260924 12:57:13.960153 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 27856
I20260924 12:57:13.974923 28000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:13.961267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50632 (local address 127.11.49.67:46061)
0924 12:57:13.961551 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:13.961558 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:13.961576 (+ 18us) server_negotiation.cc:407] Connection header received
0924 12:57:13.961635 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:13.961639 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:13.961733 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:13.961853 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:13.963391 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.964128 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.965520 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:13.965932 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:13.966068 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:13.968803 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:13.968819 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:13.968834 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:13.968873 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:13.971967 (+ 3094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.972803 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.972810 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.972812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.972949 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:13.973345 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:13.973350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:13.973351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:13.973709 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:13.974029 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:13.974328 (+ 299us) server_negotiation.cc:299] Negotiation successful
0924 12:57:13.974546 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260924 12:57:13.975914 27979 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:57:14.016965 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:14.016484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36931 (local address 127.0.0.1:60650)
0924 12:57:14.016689 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:14.016776 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:36931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260924 12:57:14.018483 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:14.017993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36931 (local address 127.0.0.1:60654)
0924 12:57:14.018272 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:14.018364 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:36931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172}
I20260924 12:57:14.083309 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 27856
I20260924 12:57:14.103174 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 27503
I20260924 12:57:14.104843 27566 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:57:14.246908 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:14.245516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:36931 (local address 127.0.0.1:60664)
0924 12:57:14.245911 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:14.246053 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:36931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269}
I20260924 12:57:14.247229 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 27503
I20260924 12:57:34.275758 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42479
--webserver_interface=127.11.49.126
--webserver_port=34643
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:42479
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:57:34.731973 28033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:34.732518 28033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:34.732693 28033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:34.741586 28033 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260924 12:57:34.741797 28033 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260924 12:57:34.741878 28033 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260924 12:57:34.741976 28033 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:57:34.742091 28033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:34.742223 28033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:34.742303 28033 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:57:34.742388 28033 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:57:34.754557 28033 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:42479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=34643
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:34.756464 28033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:34.758282 28033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:34.774335 28038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:34.774456 28039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:34.774397 28041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:34.774789 28033 server_base.cc:1034] running on GCE node
I20260924 12:57:34.776582 28033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:34.778679 28033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:34.780099 28033 hybrid_clock.cc:648] HybridClock initialized: now 1790254654779974 us; error 77 us; skew 500 ppm
I20260924 12:57:34.780725 28033 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:34 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254654, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:34.791890 28033 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:57:34.794437 28033 webserver.cc:460] Webserver started at http://127.11.49.126:34643/ using document root <none> and password file <none>
I20260924 12:57:34.795490 28033 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:34.795641 28033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:34.803956 28033 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.001s
I20260924 12:57:34.808533 28048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:34.810598 28033 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:57:34.810809 28033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "5baa77c315ff4094ba71dc9d2541850a"
format_stamp: "Formatted at 2026-09-24 12:56:47 on dist-test-slave-m9hg"
server_key: "7955682a4b94944471208fe6d3b415f6"
server_key_iv: "dcc58e0951f6ae32bd9dbee5b819d57c"
server_key_version: "encryptionkey@0"
I20260924 12:57:34.811993 28033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:34.840593 28033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:34.846594 28033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:34.846938 28033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:34.872818 28033 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:42479
I20260924 12:57:34.872884 28099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:42479 every 8 connection(s)
I20260924 12:57:34.875170 28033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:57:34.883460 28100 sys_catalog.cc:263] Verifying existing consensus state
I20260924 12:57:34.883436 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 28033
I20260924 12:57:34.884801 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:36931
--local_ip_for_outbound_sockets=127.11.49.65
--tserver_master_addrs=127.11.49.126:42479
--webserver_port=38789
--webserver_interface=127.11.49.65
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:57:34.887343 28100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Bootstrap starting.
I20260924 12:57:34.914708 28100 log.cc:824] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:57:34.937821 28100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 12:57:34.938607 28100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Bootstrap complete.
I20260924 12:57:34.952600 28100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:57:34.954142 28100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5baa77c315ff4094ba71dc9d2541850a, State: Initialized, Role: FOLLOWER
I20260924 12:57:34.954998 28100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:57:34.955302 28100 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:57:34.955446 28100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:57:34.955634 28100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 2 FOLLOWER]: Advancing to term 3
I20260924 12:57:34.962245 28100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:57:34.963102 28100 leader_election.cc:302] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5baa77c315ff4094ba71dc9d2541850a; no voters:
I20260924 12:57:34.964071 28100 leader_election.cc:288] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260924 12:57:34.965088 28104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 3 FOLLOWER]: Leader election won for term 3
I20260924 12:57:34.966018 28104 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [term 3 LEADER]: Becoming Leader. State: Replica: 5baa77c315ff4094ba71dc9d2541850a, State: Running, Role: LEADER
I20260924 12:57:34.966933 28104 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } }
I20260924 12:57:34.967666 28100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:57:34.969985 28106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5baa77c315ff4094ba71dc9d2541850a. Latest consensus state: current_term: 3 leader_uuid: "5baa77c315ff4094ba71dc9d2541850a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } } }
I20260924 12:57:34.970461 28106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: This master's current role is: LEADER
I20260924 12:57:34.971194 28105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "5baa77c315ff4094ba71dc9d2541850a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5baa77c315ff4094ba71dc9d2541850a" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42479 } } }
I20260924 12:57:34.971575 28105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a [sys.catalog]: This master's current role is: LEADER
I20260924 12:57:34.980993 28109 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:57:34.993024 28109 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:57:34.995276 28109 catalog_manager.cc:1259] Loaded cluster ID: 3e2b6812080648a4bd1d7a80af1a58d6
I20260924 12:57:34.995514 28109 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:57:35.001169 28109 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:57:35.005225 28109 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Loaded TSK: 0
I20260924 12:57:35.005483 28109 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5baa77c315ff4094ba71dc9d2541850a: Loaded TSK: 1
F20260924 12:57:35.006928 28109 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fee2959f9ad google::LogMessage::Fail() at ??:0
@ 0x7fee295a288a google::LogMessage::SendToLog() at ??:0
@ 0x7fee2959f4de google::LogMessage::Flush() at ??:0
@ 0x7fee295a0a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fee2d3037d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fee2d2f273e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fee3efd21c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fee3efd1783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fee3f05d2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fee3f05d0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fee3f0a75e9 std::function<>::operator()() at ??:0
@ 0x7fee3efd5cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fee3efd3c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fee3f05b610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fee3f05b439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fee2c1eb345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fee2c1ee91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fee2c1ee799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fee2c1c9eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fee2f4a36db start_thread at ??:0
@ 0x7fee2843961f clone at ??:0
W20260924 12:57:35.355053 28102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:35.355396 28102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:35.355501 28102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:35.363732 28102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:35.363888 28102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:35.364012 28102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:57:35.374401 28102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:36931
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=38789
--tserver_master_addrs=127.11.49.126:42479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:35.375757 28102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:35.377151 28102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:35.393524 28150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:35.393592 28147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:35.393613 28148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:35.394760 28102 server_base.cc:1034] running on GCE node
I20260924 12:57:35.395430 28102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:35.396550 28102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:35.397800 28102 hybrid_clock.cc:648] HybridClock initialized: now 1790254655397707 us; error 85 us; skew 500 ppm
I20260924 12:57:35.398149 28102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:35 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254655, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:35.402339 28102 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:57:35.404202 28102 webserver.cc:460] Webserver started at http://127.11.49.65:38789/ using document root <none> and password file <none>
I20260924 12:57:35.405033 28102 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:35.405192 28102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:35.412201 28102 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.002s
I20260924 12:57:35.415930 28157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:35.417759 28102 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:57:35.418013 28102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "cccc2a7614844c82ae3d15a15edded1a"
format_stamp: "Formatted at 2026-09-24 12:56:48 on dist-test-slave-m9hg"
server_key: "a2ee7f17c1d5e59d28e1b4d8b14a4bc3"
server_key_iv: "c906584fb96a3d74d1cff415563b6ba7"
server_key_version: "encryptionkey@0"
I20260924 12:57:35.419281 28102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:35.441258 28102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:35.446353 28102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:35.446650 28102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:35.447793 28102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:57:35.449344 28102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:57:35.449467 28102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:35.449609 28102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:57:35.449704 28102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:35.490645 28102 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:36931
I20260924 12:57:35.490756 28269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:36931 every 8 connection(s)
I20260924 12:57:35.492316 28102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:57:35.494762 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 28102
I20260924 12:57:35.495468 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:44419
--local_ip_for_outbound_sockets=127.11.49.66
--tserver_master_addrs=127.11.49.126:42479
--webserver_port=41727
--webserver_interface=127.11.49.66
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:57:35.499034 28272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:35.496418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:47169)
0924 12:57:35.497517 (+ 1099us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:35.497847 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":471,"threads_started":1}
W20260924 12:57:35.499948 28270 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:42479 (0 consecutive failures): Network error: Failed to ping master at 127.11.49.126:42479: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
I20260924 12:57:35.501308 28272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:35.500814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:56509)
0924 12:57:35.501063 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:35.501169 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260924 12:57:35.502650 28272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:35.502201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:54475)
0924 12:57:35.502388 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:35.502492 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260924 12:57:35.502981 28270 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260924 12:57:35.913322 28273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:35.913740 28273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:35.913856 28273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:35.922719 28273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:35.922906 28273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:35.923055 28273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:57:35.936065 28273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:44419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=41727
--tserver_master_addrs=127.11.49.126:42479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:35.937942 28273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:35.939648 28273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:35.957571 28278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:35.958170 28281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:35.958366 28279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:35.958930 28273 server_base.cc:1034] running on GCE node
I20260924 12:57:35.959998 28273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:35.961535 28273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:35.962855 28273 hybrid_clock.cc:648] HybridClock initialized: now 1790254655962757 us; error 79 us; skew 500 ppm
I20260924 12:57:35.963390 28273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:35 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254655, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:35.968741 28273 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:57:35.971182 28273 webserver.cc:460] Webserver started at http://127.11.49.66:41727/ using document root <none> and password file <none>
I20260924 12:57:35.972201 28273 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:35.972419 28273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:35.980063 28273 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.001s
I20260924 12:57:35.984444 28288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:35.986701 28273 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260924 12:57:35.987041 28273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "cbb5fcac28ab4db5aaa48f041c7a69cb"
format_stamp: "Formatted at 2026-09-24 12:56:49 on dist-test-slave-m9hg"
server_key: "8eb1ce569b7be37bec08e5184b70093e"
server_key_iv: "c3a56bbab13eb2edfcb081097362d8f2"
server_key_version: "encryptionkey@0"
I20260924 12:57:35.988654 28273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:36.008194 28273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:36.013147 28273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:36.013417 28273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:36.014549 28273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:57:36.016207 28273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:57:36.016355 28273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260924 12:57:36.016481 28273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:57:36.016582 28273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:36.055012 28273 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:44419
I20260924 12:57:36.055117 28400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:44419 every 8 connection(s)
I20260924 12:57:36.057027 28273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:57:36.063123 28403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:36.060772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:56137)
0924 12:57:36.061833 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:36.062129 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":432,"threads_started":1}
W20260924 12:57:36.064013 28401 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:42479 (0 consecutive failures): Network error: Failed to ping master at 127.11.49.126:42479: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
I20260924 12:57:36.065227 28403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:36.064833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:43479)
0924 12:57:36.065012 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:36.065107 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260924 12:57:36.066536 28403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:36.066174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:35571)
0924 12:57:36.066323 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:36.066422 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260924 12:57:36.066872 28401 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260924 12:57:36.067446 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 28273
I20260924 12:57:36.068149 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:46061
--local_ip_for_outbound_sockets=127.11.49.67
--tserver_master_addrs=127.11.49.126:42479
--webserver_port=38995
--webserver_interface=127.11.49.67
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:57:36.504756 28408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:36.503683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:45005)
0924 12:57:36.504315 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:36.504478 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":314,"threads_started":1}
W20260924 12:57:36.510044 28404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:36.510506 28404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:36.510705 28404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:36.519883 28404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:36.520120 28404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:36.520391 28404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:57:36.532353 28404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:46061
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=38995
--tserver_master_addrs=127.11.49.126:42479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:36.534346 28404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:36.536211 28404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:36.552942 28410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:36.552994 28413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:36.553038 28411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:36.554388 28404 server_base.cc:1034] running on GCE node
I20260924 12:57:36.555318 28404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:36.556794 28404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:36.558128 28404 hybrid_clock.cc:648] HybridClock initialized: now 1790254656558037 us; error 66 us; skew 500 ppm
I20260924 12:57:36.558595 28404 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:36 dist-test-slave-m9hg krb5kdc[26951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254656, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:36.562985 28404 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:57:36.565315 28404 webserver.cc:460] Webserver started at http://127.11.49.67:38995/ using document root <none> and password file <none>
I20260924 12:57:36.566321 28404 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:36.566515 28404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:36.573938 28404 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260924 12:57:36.578122 28420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:36.580202 28404 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:57:36.580575 28404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "9c8e582db64d4578842f5c508e24255c"
format_stamp: "Formatted at 2026-09-24 12:56:49 on dist-test-slave-m9hg"
server_key: "ec95e2d2ad4cc72a0025bb79d98b768c"
server_key_iv: "1d6713f7953b9a82160d1eef1fe9174d"
server_key_version: "encryptionkey@0"
I20260924 12:57:36.581897 28404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:36.599298 28404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:36.605393 28404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:36.605854 28404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:36.607252 28404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:57:36.609556 28404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:57:36.609750 28404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:36.609930 28404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:57:36.610037 28404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:36.654300 28404 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:46061
I20260924 12:57:36.654340 28532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:46061 every 8 connection(s)
I20260924 12:57:36.656375 28404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:57:36.660940 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 28404
I20260924 12:57:36.662701 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:36.659839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:44913)
0924 12:57:36.661080 (+ 1241us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:36.661444 (+ 364us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":746,"thread_start_us":479,"threads_started":1}
W20260924 12:57:36.663688 28533 heartbeater.cc:644] Failed to heartbeat to 127.11.49.126:42479 (0 consecutive failures): Network error: Failed to ping master at 127.11.49.126:42479: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
I20260924 12:57:36.664867 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:36.664467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:54705)
0924 12:57:36.664645 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:36.664735 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260924 12:57:36.665874 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:36.665530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:40059)
0924 12:57:36.665674 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:36.665757 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260924 12:57:36.666169 28533 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260924 12:57:37.068853 28537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:37.067732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:33027)
0924 12:57:37.068430 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:37.068559 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":318,"threads_started":1}
I20260924 12:57:37.506906 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:37.505968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:57977)
0924 12:57:37.506582 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:37.506683 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":317,"threads_started":1}
I20260924 12:57:37.668407 28539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:37.667045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:53675)
0924 12:57:37.667798 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:37.667954 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":363,"threads_started":1}
I20260924 12:57:38.071317 28540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:38.070322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:46445)
0924 12:57:38.070991 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:38.071107 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":332,"threads_started":1}
I20260924 12:57:38.509461 28541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:38.508406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:45381)
0924 12:57:38.509079 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:38.509220 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":327,"threads_started":1}
I20260924 12:57:38.670966 28542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:38.669929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:45969)
0924 12:57:38.670618 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:38.670760 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":355,"threads_started":1}
I20260924 12:57:39.073873 28543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:39.072838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:34431)
0924 12:57:39.073516 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:39.073643 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":342,"threads_started":1}
I20260924 12:57:39.512023 28544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:39.510929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:56131)
0924 12:57:39.511597 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:39.511744 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":339,"threads_started":1}
I20260924 12:57:39.673429 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:39.672440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:56333)
0924 12:57:39.673119 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:39.673229 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":368,"threads_started":1}
I20260924 12:57:40.076478 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:40.075301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:37733)
0924 12:57:40.075990 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:40.076120 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":340,"threads_started":1}
I20260924 12:57:40.514405 28547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:40.513386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:55835)
0924 12:57:40.514042 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:40.514166 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":343,"threads_started":1}
I20260924 12:57:40.675925 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:40.674883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:33759)
0924 12:57:40.675539 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:40.675697 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":368,"threads_started":1}
I20260924 12:57:41.078883 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:41.077865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:53383)
0924 12:57:41.078528 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:41.078653 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":329,"threads_started":1}
I20260924 12:57:41.516601 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:41.515573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:60079)
0924 12:57:41.516230 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:41.516407 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":360,"threads_started":1}
I20260924 12:57:41.678544 28551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:41.677445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:46249)
0924 12:57:41.678154 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:41.678282 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":330,"threads_started":1}
I20260924 12:57:42.081449 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:42.080460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:45151)
0924 12:57:42.081107 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:42.081219 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":387,"threads_started":1}
I20260924 12:57:42.519313 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:42.518143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:53515)
0924 12:57:42.518897 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:42.519035 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":335,"threads_started":1}
I20260924 12:57:42.681627 28554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:42.680681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:50439)
0924 12:57:42.681309 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:42.681445 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":325,"threads_started":1}
I20260924 12:57:43.083940 28555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:43.082767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:48633)
0924 12:57:43.083453 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:43.083574 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":308,"threads_started":1}
I20260924 12:57:43.521868 28556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:43.520902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:35093)
0924 12:57:43.521498 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:43.521644 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":301,"threads_started":1}
I20260924 12:57:43.684477 28557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:43.682933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:41563)
0924 12:57:43.683710 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:43.684037 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":350,"threads_started":1}
I20260924 12:57:44.087251 28558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:44.085428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:32791)
0924 12:57:44.086909 (+ 1481us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:44.087033 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1319,"thread_start_us":1062,"threads_started":1}
I20260924 12:57:44.524252 28559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:44.523138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:55355)
0924 12:57:44.523815 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:44.523940 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":342,"threads_started":1}
I20260924 12:57:44.686851 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:44.685740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:46803)
0924 12:57:44.686494 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:44.686614 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":386,"threads_started":1}
I20260924 12:57:45.089480 28561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:45.088513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:51663)
0924 12:57:45.089146 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:45.089261 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":308,"threads_started":1}
I20260924 12:57:45.526518 28562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:45.525561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:44019)
0924 12:57:45.526173 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:45.526291 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":326,"threads_started":1}
I20260924 12:57:45.689545 28563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:45.688327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:43229)
0924 12:57:45.689119 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:45.689248 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":366,"threads_started":1}
I20260924 12:57:46.091933 28564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:46.090822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:35569)
0924 12:57:46.091588 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:46.091705 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":349,"threads_started":1}
I20260924 12:57:46.528923 28565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:46.527680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:33377)
0924 12:57:46.528473 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:46.528621 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":358,"threads_started":1}
I20260924 12:57:46.692044 28566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:46.691068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:56673)
0924 12:57:46.691706 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:46.691819 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":339,"threads_started":1}
I20260924 12:57:47.094478 28567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:47.093250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:38639)
0924 12:57:47.094131 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:47.094254 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":482,"threads_started":1}
I20260924 12:57:47.531181 28568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:47.530232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:60191)
0924 12:57:47.530853 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:47.531002 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":332,"threads_started":1}
I20260924 12:57:47.694293 28569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:47.693241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:54469)
0924 12:57:47.693917 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:47.694055 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":344,"threads_started":1}
I20260924 12:57:48.096748 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:48.095591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:37495)
0924 12:57:48.096389 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:48.096534 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":347,"threads_started":1}
I20260924 12:57:48.533839 28571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:48.532634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:37663)
0924 12:57:48.533438 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:48.533599 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":383,"threads_started":1}
I20260924 12:57:48.696910 28572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:48.695726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:44067)
0924 12:57:48.696513 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:48.696626 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":439,"threads_started":1}
I20260924 12:57:49.099014 28573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:49.097986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:60795)
0924 12:57:49.098635 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:49.098752 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":316,"threads_started":1}
I20260924 12:57:49.536209 28574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:49.535228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:60277)
0924 12:57:49.535870 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:49.536006 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":316,"threads_started":1}
I20260924 12:57:49.699366 28575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:49.698255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:52653)
0924 12:57:49.699016 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:49.699148 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":345,"threads_started":1}
I20260924 12:57:50.101459 28576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:50.100486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:50487)
0924 12:57:50.101127 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:50.101247 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":310,"threads_started":1}
I20260924 12:57:50.538753 28577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:50.537665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:59183)
0924 12:57:50.538370 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:50.538507 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":347,"threads_started":1}
I20260924 12:57:50.701634 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:50.700681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:55209)
0924 12:57:50.701310 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:50.701429 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":329,"threads_started":1}
I20260924 12:57:51.104254 28579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:51.103148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:41637)
0924 12:57:51.103934 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:51.104052 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":388,"threads_started":1}
I20260924 12:57:51.541297 28580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:51.540258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.65:55151)
0924 12:57:51.540973 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:51.541110 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":327,"threads_started":1}
I20260924 12:57:51.674292 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 28102
I20260924 12:57:51.704520 28582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:51.703320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.67:51253)
0924 12:57:51.704010 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:51.704167 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":307,"threads_started":1}
I20260924 12:57:52.106662 28583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:52.105560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:42479 (local address 127.11.49.66:51321)
0924 12:57:52.106310 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:52.106454 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.126:42479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":382,"threads_started":1}
I20260924 12:57:52.222224 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:51.675820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45582 (local address 127.11.49.65:36931)
0924 12:57:51.676567 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:51.676582 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:52.201331 (+524749us) server_negotiation.cc:407] Connection header received
0924 12:57:52.203133 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:52.203143 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:52.203628 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:52.203988 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:52.206300 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:52.207634 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:52.209413 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:52.210217 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:52.210388 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:52.214357 (+ 3969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:52.214366 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:52.214385 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:52.214454 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:52.217952 (+ 3498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:52.219096 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:52.219104 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:52.219112 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:52.219336 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:52.219880 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:52.219884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:52.219886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:52.220577 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:52.220863 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:52.221464 (+ 601us) server_negotiation.cc:299] Negotiation successful
0924 12:57:52.221899 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":344,"threads_started":1}
I20260924 12:57:52.223901 28265 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:57:52.316998 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 28102
I20260924 12:57:52.337427 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 28273
I20260924 12:57:52.360823 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:52.339073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60304 (local address 127.11.49.66:44419)
0924 12:57:52.339895 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:52.339910 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:52.339958 (+ 48us) server_negotiation.cc:407] Connection header received
0924 12:57:52.341905 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:52.341915 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:52.342350 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:52.342648 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:52.344611 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:52.345869 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:52.347467 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:52.348156 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:52.348443 (+ 287us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:52.352561 (+ 4118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:52.352572 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:52.352590 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:52.352644 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:52.356450 (+ 3806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:52.357476 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:52.357484 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:52.357491 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:52.357706 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:52.358217 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:52.358223 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:52.358227 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:52.358956 (+ 729us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:52.359271 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:52.359854 (+ 583us) server_negotiation.cc:299] Negotiation successful
0924 12:57:52.360451 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":412,"threads_started":1}
I20260924 12:57:52.362867 28396 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:57:52.462908 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 28273
I20260924 12:57:52.483775 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 28404
I20260924 12:57:52.507179 28587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:52.485010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45380 (local address 127.11.49.67:46061)
0924 12:57:52.485668 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:52.485686 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:52.485734 (+ 48us) server_negotiation.cc:407] Connection header received
0924 12:57:52.488160 (+ 2426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:52.488171 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:52.488907 (+ 736us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:52.489363 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:52.491135 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:52.492691 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:52.494219 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:52.495075 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:52.495308 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:52.498852 (+ 3544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:52.498864 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:52.498887 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:52.498953 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:52.502749 (+ 3796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:52.503752 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:52.503761 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:52.503771 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:52.504009 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:52.504557 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:52.504564 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:52.504567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:52.505339 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:52.505723 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:52.506276 (+ 553us) server_negotiation.cc:299] Negotiation successful
0924 12:57:52.506830 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":293,"threads_started":1}
I20260924 12:57:52.509258 28528 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:57:52.601336 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 28404
2026-09-24T12:57:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (66829 ms)
[----------] 30 tests from SecurityITest (345581 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:57:52 dist-test-slave-m9hg krb5kdc[28591](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:57:52 dist-test-slave-m9hg krb5kdc[28591](info): set up 2 sockets
Sep 24 12:57:52 dist-test-slave-m9hg krb5kdc[28591](info): commencing operation
krb5kdc: starting...
W20260924 12:57:53.793334 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:57:53 dist-test-slave-m9hg krb5kdc[28591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:57:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:57:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:57:54.113626 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:41649
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:41649
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:57:54.495129 28604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:54.495534 28604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:54.495711 28604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:54.503445 28604 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:57:54.503621 28604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:54.503732 28604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:54.503839 28604 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:57:54.503921 28604 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:57:54.514487 28604 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:41649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:41649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:54.515947 28604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:54.517331 28604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:54.532202 28609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:54.532305 28612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:54.532140 28610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:54.538286 28604 server_base.cc:1034] running on GCE node
I20260924 12:57:54.539280 28604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:54.541129 28604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:54.542392 28604 hybrid_clock.cc:648] HybridClock initialized: now 1790254674542334 us; error 65 us; skew 500 ppm
I20260924 12:57:54.542765 28604 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:54 dist-test-slave-m9hg krb5kdc[28591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254674, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:54.546452 28604 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:57:54.549177 28604 webserver.cc:460] Webserver started at http://127.11.49.126:38713/ using document root <none> and password file <none>
I20260924 12:57:54.550091 28604 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:54.550251 28604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:54.550631 28604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:57:54.554205 28604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "00f1fff37cb342349557a57a44dd9a81"
format_stamp: "Formatted at 2026-09-24 12:57:54 on dist-test-slave-m9hg"
server_key: "ef323f7a6dc48ad55bf0da3c2473cefa"
server_key_iv: "10ec8f11050108229434a87a635bb0b8"
server_key_version: "encryptionkey@0"
I20260924 12:57:54.555155 28604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "00f1fff37cb342349557a57a44dd9a81"
format_stamp: "Formatted at 2026-09-24 12:57:54 on dist-test-slave-m9hg"
server_key: "ef323f7a6dc48ad55bf0da3c2473cefa"
server_key_iv: "10ec8f11050108229434a87a635bb0b8"
server_key_version: "encryptionkey@0"
I20260924 12:57:54.561789 28604 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260924 12:57:54.566521 28619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:54.568607 28604 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:57:54.568881 28604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "00f1fff37cb342349557a57a44dd9a81"
format_stamp: "Formatted at 2026-09-24 12:57:54 on dist-test-slave-m9hg"
server_key: "ef323f7a6dc48ad55bf0da3c2473cefa"
server_key_iv: "10ec8f11050108229434a87a635bb0b8"
server_key_version: "encryptionkey@0"
I20260924 12:57:54.569133 28604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:54.586809 28604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:54.591634 28604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:54.591972 28604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:54.614557 28604 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:41649
I20260924 12:57:54.614624 28670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:41649 every 8 connection(s)
I20260924 12:57:54.616101 28604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:57:54.616739 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 28604
I20260924 12:57:54.617038 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:57:54.617923 11461 external_mini_cluster.cc:1428] Setting key c518155047eea0ff71daf0160e59e4d0
I20260924 12:57:54.620947 28671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:57:54.634919 28671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81: Bootstrap starting.
Sep 24 12:57:54 dist-test-slave-m9hg krb5kdc[28591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:57:54.638780 28671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81: Neither blocks nor log segments found. Creating new log.
I20260924 12:57:54.640233 28671 log.cc:824] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81: Log is configured to *not* fsync() on all Append() calls
I20260924 12:57:54.644281 28671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81: No bootstrap required, opened a new log
I20260924 12:57:54.655800 28674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:54.620466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48266 (local address 127.11.49.126:41649)
0924 12:57:54.621666 (+ 1200us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:54.621685 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:54.621742 (+ 57us) server_negotiation.cc:407] Connection header received
0924 12:57:54.623876 (+ 2134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:54.623909 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:54.624655 (+ 746us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:54.625247 (+ 592us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:54.627316 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:54.629497 (+ 2181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:54.631307 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:54.632636 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:54.632879 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:54.638183 (+ 5304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:54.638195 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:54.638217 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:54.638278 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:54.642525 (+ 4247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:54.643622 (+ 1097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:54.643632 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:54.643642 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:54.643869 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:54.644422 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:54.644428 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:54.644431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:54.645247 (+ 816us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:54.645620 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:54.646807 (+ 1187us) server_negotiation.cc:299] Negotiation successful
0924 12:57:54.649015 (+ 2208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":876,"thread_start_us":554,"threads_started":1}
I20260924 12:57:54.660148 28671 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f1fff37cb342349557a57a44dd9a81" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41649 } }
I20260924 12:57:54.660863 28671 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:57:54.661024 28671 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00f1fff37cb342349557a57a44dd9a81, State: Initialized, Role: FOLLOWER
I20260924 12:57:54.661828 28671 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f1fff37cb342349557a57a44dd9a81" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41649 } }
I20260924 12:57:54.662168 28671 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:57:54.662338 28671 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:57:54.662552 28671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:57:54.666939 28671 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f1fff37cb342349557a57a44dd9a81" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41649 } }
I20260924 12:57:54.667786 28671 leader_election.cc:302] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00f1fff37cb342349557a57a44dd9a81; no voters:
I20260924 12:57:54.668762 28671 leader_election.cc:288] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:57:54.669044 28676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:57:54.671577 28671 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:57:54.676501 28676 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [term 1 LEADER]: Becoming Leader. State: Replica: 00f1fff37cb342349557a57a44dd9a81, State: Running, Role: LEADER
I20260924 12:57:54.677341 28676 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f1fff37cb342349557a57a44dd9a81" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41649 } }
I20260924 12:57:54.682269 28677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00f1fff37cb342349557a57a44dd9a81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f1fff37cb342349557a57a44dd9a81" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41649 } } }
I20260924 12:57:54.682814 28677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [sys.catalog]: This master's current role is: LEADER
I20260924 12:57:54.686841 28678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00f1fff37cb342349557a57a44dd9a81. Latest consensus state: current_term: 1 leader_uuid: "00f1fff37cb342349557a57a44dd9a81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f1fff37cb342349557a57a44dd9a81" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 41649 } } }
I20260924 12:57:54.688257 28678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81 [sys.catalog]: This master's current role is: LEADER
I20260924 12:57:54.701910 28682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:57:54.710461 28682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:57:54.736883 28682 catalog_manager.cc:1347] Generated new cluster ID: 279ad91c6ad048519f3c6869de5fbc10
I20260924 12:57:54.737072 28682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:57:54.768517 28682 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:57:54.771124 28682 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:57:54.794137 28682 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81: Generated new TSK 0
I20260924 12:57:54.795558 28682 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:57:54.911276 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41649
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:57:55.378695 28697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:55.379109 28697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:55.379313 28697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:55.389704 28697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:55.389874 28697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:55.390102 28697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:57:55.402163 28697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41649
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:55.404675 28697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:55.406663 28697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:55.425669 28703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:55.425799 28702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:55.425828 28705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:55.427225 28697 server_base.cc:1034] running on GCE node
I20260924 12:57:55.428193 28697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:55.429667 28697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:55.430939 28697 hybrid_clock.cc:648] HybridClock initialized: now 1790254675430880 us; error 58 us; skew 500 ppm
I20260924 12:57:55.431398 28697 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:55 dist-test-slave-m9hg krb5kdc[28591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254675, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:55.436118 28697 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:57:55.438601 28697 webserver.cc:460] Webserver started at http://127.11.49.65:46153/ using document root <none> and password file <none>
I20260924 12:57:55.439814 28697 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:55.440048 28697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:55.440573 28697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:57:55.444569 28697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "44920d4f58b04a45a23cdae3afaf4702"
format_stamp: "Formatted at 2026-09-24 12:57:55 on dist-test-slave-m9hg"
server_key: "1963fddb0e84a538c764295cebbe88e6"
server_key_iv: "913b22bffa8f3c64160836cbf5f63463"
server_key_version: "encryptionkey@0"
I20260924 12:57:55.445613 28697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "44920d4f58b04a45a23cdae3afaf4702"
format_stamp: "Formatted at 2026-09-24 12:57:55 on dist-test-slave-m9hg"
server_key: "1963fddb0e84a538c764295cebbe88e6"
server_key_iv: "913b22bffa8f3c64160836cbf5f63463"
server_key_version: "encryptionkey@0"
I20260924 12:57:55.452876 28697 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260924 12:57:55.458050 28712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:55.460156 28697 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260924 12:57:55.460551 28697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "44920d4f58b04a45a23cdae3afaf4702"
format_stamp: "Formatted at 2026-09-24 12:57:55 on dist-test-slave-m9hg"
server_key: "1963fddb0e84a538c764295cebbe88e6"
server_key_iv: "913b22bffa8f3c64160836cbf5f63463"
server_key_version: "encryptionkey@0"
I20260924 12:57:55.460853 28697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:55.478816 28697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:55.485322 28697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:55.485752 28697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:55.487103 28697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:57:55.489120 28697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:57:55.489248 28697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:55.489426 28697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:57:55.489529 28697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:55.536098 28697 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:45211
I20260924 12:57:55.536157 28824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:45211 every 8 connection(s)
I20260924 12:57:55.537994 28697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:57:55.547043 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 28697
I20260924 12:57:55.547279 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:57:55.548261 11461 external_mini_cluster.cc:1428] Setting key 3349d7f124ae8f12ed4e0376c194a2cc
Sep 24 12:57:55 dist-test-slave-m9hg krb5kdc[28591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254675, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:57:55.566776 28827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:55.541568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:52755 (local address 127.11.49.126:41649)
0924 12:57:55.542286 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:55.542292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:55.543230 (+ 938us) server_negotiation.cc:407] Connection header received
0924 12:57:55.545732 (+ 2502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:55.545739 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:55.545864 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:55.546027 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:55.548223 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:55.549219 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:55.551537 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:55.552122 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:55.552352 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:55.558344 (+ 5992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:55.558353 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:55.558357 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:55.558412 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:55.562284 (+ 3872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:55.563440 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:55.563449 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:55.563458 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:55.563627 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:55.564192 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:55.564198 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:55.564201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:55.564706 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:55.564920 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:55.565945 (+ 1025us) server_negotiation.cc:299] Negotiation successful
0924 12:57:55.566289 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":446,"threads_started":1}
I20260924 12:57:55.568128 28828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:55.541985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:41649 (local address 127.11.49.65:52755)
0924 12:57:55.542977 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:55.543050 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:55.545307 (+ 2257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:55.546351 (+ 1044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:55.546362 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:55.547073 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:57:55.547977 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:55.548002 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:55.549437 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:55.549446 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:55.551238 (+ 1792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:55.551256 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:55.552542 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:55.552553 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:55.552891 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:55.554034 (+ 1143us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:57:55.554073 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:57:55.557710 (+ 3637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:57:55.562598 (+ 4888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:55.562610 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:55.562632 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:55.563265 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:55.563774 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:55.563780 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:55.563784 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:55.564053 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:55.564855 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:57:55.564867 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:57:55.565421 (+ 554us) client_negotiation.cc:769] Sending connection context
0924 12:57:55.565853 (+ 432us) client_negotiation.cc:240] Negotiation successful
0924 12:57:55.566604 (+ 751us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":406,"threads_started":1}
I20260924 12:57:55.570715 28825 heartbeater.cc:347] Connected to a master server at 127.11.49.126:41649
I20260924 12:57:55.571233 28825 heartbeater.cc:464] Registering TS with master...
I20260924 12:57:55.572541 28825 heartbeater.cc:511] Master 127.11.49.126:41649 requested a full tablet report, sending...
I20260924 12:57:55.576228 28636 ts_manager.cc:194] Registered new tserver with Master: 44920d4f58b04a45a23cdae3afaf4702 (127.11.49.65:45211)
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:57:55.578989 28636 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:52755
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:57:55.625638 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41649
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:57:55.988605 28831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:55.988960 28831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:55.989135 28831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:55.996877 28831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:55.997061 28831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:55.997323 28831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:57:56.007550 28831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41649
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:56.009093 28831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:56.010499 28831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:56.027117 28837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:56.027184 28839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:56.027041 28836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:56.029358 28831 server_base.cc:1034] running on GCE node
I20260924 12:57:56.030133 28831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:56.031360 28831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:56.032686 28831 hybrid_clock.cc:648] HybridClock initialized: now 1790254676032596 us; error 84 us; skew 500 ppm
I20260924 12:57:56.033139 28831 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:56 dist-test-slave-m9hg krb5kdc[28591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254676, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:56.037246 28831 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:57:56.039197 28831 webserver.cc:460] Webserver started at http://127.11.49.66:39057/ using document root <none> and password file <none>
I20260924 12:57:56.040023 28831 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:56.040174 28831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:56.040628 28831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:57:56.043941 28831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "2acc7de738084e868bee9484dcd4bf45"
format_stamp: "Formatted at 2026-09-24 12:57:56 on dist-test-slave-m9hg"
server_key: "1c522b6bff9478dd6f90ba600f35e704"
server_key_iv: "e02b4cc92df3d128e70f581f88971c83"
server_key_version: "encryptionkey@0"
I20260924 12:57:56.045302 28831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "2acc7de738084e868bee9484dcd4bf45"
format_stamp: "Formatted at 2026-09-24 12:57:56 on dist-test-slave-m9hg"
server_key: "1c522b6bff9478dd6f90ba600f35e704"
server_key_iv: "e02b4cc92df3d128e70f581f88971c83"
server_key_version: "encryptionkey@0"
I20260924 12:57:56.051353 28831 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260924 12:57:56.055873 28846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:56.057708 28831 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:57:56.057938 28831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "2acc7de738084e868bee9484dcd4bf45"
format_stamp: "Formatted at 2026-09-24 12:57:56 on dist-test-slave-m9hg"
server_key: "1c522b6bff9478dd6f90ba600f35e704"
server_key_iv: "e02b4cc92df3d128e70f581f88971c83"
server_key_version: "encryptionkey@0"
I20260924 12:57:56.058174 28831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:56.077749 28831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:56.082607 28831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:56.082952 28831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:56.084067 28831 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:57:56.085702 28831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:57:56.085824 28831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:56.085984 28831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:57:56.086059 28831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:56.128494 28831 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:42557
I20260924 12:57:56.128618 28958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:42557 every 8 connection(s)
I20260924 12:57:56.130268 28831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:57:56.133301 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 28831
I20260924 12:57:56.133533 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:57:56.134229 11461 external_mini_cluster.cc:1428] Setting key 36780141d5be52f745ba904a251fcd2e
Sep 24 12:57:56 dist-test-slave-m9hg krb5kdc[28591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254676, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:57:56.160692 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:56.133732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:48449 (local address 127.11.49.126:41649)
0924 12:57:56.134417 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:56.134427 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:56.135953 (+ 1526us) server_negotiation.cc:407] Connection header received
0924 12:57:56.138808 (+ 2855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:56.138814 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:56.138955 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:56.139130 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:56.141746 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.142586 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.145711 (+ 3125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.146723 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.146946 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:56.151389 (+ 4443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:56.151402 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:56.151411 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:56.151486 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:56.156206 (+ 4720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:56.157234 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:56.157245 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:56.157252 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:56.157484 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:56.157984 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:56.157994 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:56.158000 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:56.158525 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:56.158758 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:56.159573 (+ 815us) server_negotiation.cc:299] Negotiation successful
0924 12:57:56.160077 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":302,"threads_started":1}
I20260924 12:57:56.161049 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:56.134545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:41649 (local address 127.11.49.66:48449)
0924 12:57:56.135650 (+ 1105us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:56.135749 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:56.138391 (+ 2642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:56.139486 (+ 1095us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:56.139503 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:56.140496 (+ 993us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:57:56.141462 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:56.141493 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.142813 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.142822 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:56.145424 (+ 2602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:56.145447 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.147073 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.147085 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:56.147475 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:56.148351 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:57:56.148391 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:57:56.150896 (+ 2505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:57:56.156484 (+ 5588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:56.156492 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:56.156507 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:56.157023 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:56.157625 (+ 602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:56.157628 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:56.157631 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:56.157826 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:56.158674 (+ 848us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:57:56.158680 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:57:56.159106 (+ 426us) client_negotiation.cc:769] Sending connection context
0924 12:57:56.159358 (+ 252us) client_negotiation.cc:240] Negotiation successful
0924 12:57:56.159821 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":436,"threads_started":1}
I20260924 12:57:56.162909 28959 heartbeater.cc:347] Connected to a master server at 127.11.49.126:41649
I20260924 12:57:56.163261 28959 heartbeater.cc:464] Registering TS with master...
I20260924 12:57:56.164026 28959 heartbeater.cc:511] Master 127.11.49.126:41649 requested a full tablet report, sending...
I20260924 12:57:56.165961 28636 ts_manager.cc:194] Registered new tserver with Master: 2acc7de738084e868bee9484dcd4bf45 (127.11.49.66:42557)
I20260924 12:57:56.166996 28636 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:48449
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:57:56.214429 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41649
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:57:56.583609 28825 heartbeater.cc:503] Master 127.11.49.126:41649 was elected leader, sending a full tablet report...
W20260924 12:57:56.665647 28965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:56.666070 28965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:56.666255 28965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:56.675472 28965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:56.675712 28965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:56.675907 28965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:57:56.687875 28965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:41649
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:56.689831 28965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:56.691637 28965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:56.711433 28970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:56.711565 28971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:56.711745 28973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:56.713147 28965 server_base.cc:1034] running on GCE node
I20260924 12:57:56.714028 28965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:56.715448 28965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:56.716809 28965 hybrid_clock.cc:648] HybridClock initialized: now 1790254676716689 us; error 88 us; skew 500 ppm
I20260924 12:57:56.717371 28965 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:57:56 dist-test-slave-m9hg krb5kdc[28591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254676, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:57:56.722435 28965 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:57:56.724982 28965 webserver.cc:460] Webserver started at http://127.11.49.67:41889/ using document root <none> and password file <none>
I20260924 12:57:56.726032 28965 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:56.726233 28965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:56.726660 28965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:57:56.730865 28965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "76bf05eed88942f7b681f6a408303346"
format_stamp: "Formatted at 2026-09-24 12:57:56 on dist-test-slave-m9hg"
server_key: "9126c10cb501259034227518110393cd"
server_key_iv: "b5fd3323cee7008cda91df9a5be25590"
server_key_version: "encryptionkey@0"
I20260924 12:57:56.732033 28965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "76bf05eed88942f7b681f6a408303346"
format_stamp: "Formatted at 2026-09-24 12:57:56 on dist-test-slave-m9hg"
server_key: "9126c10cb501259034227518110393cd"
server_key_iv: "b5fd3323cee7008cda91df9a5be25590"
server_key_version: "encryptionkey@0"
I20260924 12:57:56.739884 28965 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260924 12:57:56.745858 28980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:56.748143 28965 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260924 12:57:56.748521 28965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "76bf05eed88942f7b681f6a408303346"
format_stamp: "Formatted at 2026-09-24 12:57:56 on dist-test-slave-m9hg"
server_key: "9126c10cb501259034227518110393cd"
server_key_iv: "b5fd3323cee7008cda91df9a5be25590"
server_key_version: "encryptionkey@0"
I20260924 12:57:56.748845 28965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:56.784565 28965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:56.790561 28965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:56.790992 28965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:56.792677 28965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:57:56.794535 28965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:57:56.794663 28965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:56.794838 28965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:57:56.794916 28965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:56.840512 28965 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:34683
I20260924 12:57:56.840570 29092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:34683 every 8 connection(s)
I20260924 12:57:56.842211 28965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:57:56.852636 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 28965
I20260924 12:57:56.852855 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:57:56.853314 11461 external_mini_cluster.cc:1428] Setting key bb0ceb269f2b0fba1e085f323b29b9e7
Sep 24 12:57:56 dist-test-slave-m9hg krb5kdc[28591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254676, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:57:56.868167 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:56.845719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:37955 (local address 127.11.49.126:41649)
0924 12:57:56.846319 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:56.846325 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:56.847528 (+ 1203us) server_negotiation.cc:407] Connection header received
0924 12:57:56.849859 (+ 2331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:56.849866 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:56.850012 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:56.850154 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:56.852149 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.853215 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.855706 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.856412 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.856558 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:56.860697 (+ 4139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:56.860704 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:56.860708 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:56.860758 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:56.864193 (+ 3435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:56.865233 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:56.865238 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:56.865241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:56.865406 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:56.865991 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:56.865998 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:56.866007 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:56.866408 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:56.866544 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:56.867391 (+ 847us) server_negotiation.cc:299] Negotiation successful
0924 12:57:56.867659 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":293,"threads_started":1}
I20260924 12:57:56.868947 29096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:56.846333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:41649 (local address 127.11.49.67:37955)
0924 12:57:56.847278 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:56.847340 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:56.849474 (+ 2134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:56.850490 (+ 1016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:56.850501 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:56.851173 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:57:56.851917 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:56.851939 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.853403 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.853408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:56.855525 (+ 2117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:56.855542 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.856731 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.856738 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:56.857165 (+ 427us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:56.857957 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:57:56.857989 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:57:56.860366 (+ 2377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:57:56.864481 (+ 4115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:56.864490 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:56.864504 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:56.865065 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:56.865530 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:57:56.865534 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:57:56.865536 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:57:56.865723 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:57:56.866546 (+ 823us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:57:56.866552 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:57:56.866951 (+ 399us) client_negotiation.cc:769] Sending connection context
0924 12:57:56.867241 (+ 290us) client_negotiation.cc:240] Negotiation successful
0924 12:57:56.867703 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":409,"threads_started":1}
I20260924 12:57:56.871138 29093 heartbeater.cc:347] Connected to a master server at 127.11.49.126:41649
I20260924 12:57:56.871557 29093 heartbeater.cc:464] Registering TS with master...
I20260924 12:57:56.872603 29093 heartbeater.cc:511] Master 127.11.49.126:41649 requested a full tablet report, sending...
I20260924 12:57:56.874550 28635 ts_manager.cc:194] Registered new tserver with Master: 76bf05eed88942f7b681f6a408303346 (127.11.49.67:34683)
I20260924 12:57:56.875545 28635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:37955
I20260924 12:57:56.883973 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:57:56.906304 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:56.889916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35892 (local address 127.11.49.126:41649)
0924 12:57:56.890330 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:56.890338 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:56.890753 (+ 415us) server_negotiation.cc:407] Connection header received
0924 12:57:56.891015 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:56.891021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:56.891125 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:56.891245 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:56.893073 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.893894 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.895475 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.895935 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.896101 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:56.899364 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:56.899371 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:56.899375 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:56.899427 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:56.902741 (+ 3314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:56.903806 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:56.903812 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:56.903816 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:56.903992 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:56.904487 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:56.904495 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:56.904499 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:56.904911 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:56.905250 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:56.905630 (+ 380us) server_negotiation.cc:299] Negotiation successful
0924 12:57:56.905934 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260924 12:57:56.912676 28635 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:57:56.921238 28635 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:57:56.964144 29110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:56.939340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45211 (local address 127.0.0.1:46184)
0924 12:57:56.949436 (+ 10096us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:56.949483 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:56.949732 (+ 249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:56.954198 (+ 4466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:56.954214 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:56.954273 (+ 59us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:57:56.954904 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:56.954926 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.957396 (+ 2470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.957404 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:56.960439 (+ 3035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:56.960460 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.962958 (+ 2498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.962965 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:56.963184 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:56.963256 (+ 72us) client_negotiation.cc:769] Sending connection context
0924 12:57:56.963420 (+ 164us) client_negotiation.cc:240] Negotiation successful
0924 12:57:56.963659 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9828,"mutex_wait_us":1,"thread_start_us":13481,"threads_started":1}
I20260924 12:57:56.964196 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:56.938682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46184 (local address 127.11.49.65:45211)
0924 12:57:56.952626 (+ 13944us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:56.952643 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:56.952699 (+ 56us) server_negotiation.cc:407] Connection header received
0924 12:57:56.952892 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:56.952906 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:56.953305 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:56.953681 (+ 376us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:57:56.955324 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.957189 (+ 1865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.960727 (+ 3538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.962624 (+ 1897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.962819 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:56.963183 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:56.963509 (+ 326us) server_negotiation.cc:299] Negotiation successful
0924 12:57:56.963741 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13618,"thread_start_us":16477,"threads_started":1}
I20260924 12:57:56.966264 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:56.939451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:42557 (local address 127.0.0.1:42648)
0924 12:57:56.952510 (+ 13059us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:56.952542 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:56.952727 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:56.957662 (+ 4935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:56.957667 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:56.957696 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:57:56.958533 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:56.958585 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.960622 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.960628 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:56.962593 (+ 1965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:56.962631 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.965336 (+ 2705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.965343 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:56.965522 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:56.965557 (+ 35us) client_negotiation.cc:769] Sending connection context
0924 12:57:56.965651 (+ 94us) client_negotiation.cc:240] Negotiation successful
0924 12:57:56.965802 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12806,"mutex_wait_us":103,"thread_start_us":9332,"threads_started":1}
I20260924 12:57:56.966831 29111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:56.940129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42648 (local address 127.11.49.66:42557)
0924 12:57:56.956675 (+ 16546us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:56.956683 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:56.956711 (+ 28us) server_negotiation.cc:407] Connection header received
0924 12:57:56.956807 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:56.956813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:56.957027 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:56.957396 (+ 369us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:57:56.958836 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.960433 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.962931 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.964968 (+ 2037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.965950 (+ 982us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:56.966196 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:56.966286 (+ 90us) server_negotiation.cc:299] Negotiation successful
0924 12:57:56.966485 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16356,"thread_start_us":16173,"threads_started":1}
I20260924 12:57:56.967759 29106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:56.938441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:34683 (local address 127.0.0.1:39850)
0924 12:57:56.945324 (+ 6883us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:56.945389 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:56.945660 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:56.957217 (+ 11557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:56.957223 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:56.957267 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:57:56.957855 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:56.957874 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.960160 (+ 2286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.960166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:56.962841 (+ 2675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:56.962862 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.966794 (+ 3932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.966803 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:56.967005 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:56.967045 (+ 40us) client_negotiation.cc:769] Sending connection context
0924 12:57:56.967128 (+ 83us) client_negotiation.cc:240] Negotiation successful
0924 12:57:56.967310 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6485,"mutex_wait_us":72,"thread_start_us":537,"threads_started":1}
I20260924 12:57:56.969662 28760 tablet_service.cc:1467] Processing CreateTablet for tablet e29ae2de46bd490da5819f99ec30eb7b (DEFAULT_TABLE table=test-table [id=07c265ba1b5a41aab394557fce423011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:57:56.970597 28894 tablet_service.cc:1467] Processing CreateTablet for tablet e29ae2de46bd490da5819f99ec30eb7b (DEFAULT_TABLE table=test-table [id=07c265ba1b5a41aab394557fce423011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:57:56.971632 28760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29ae2de46bd490da5819f99ec30eb7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:57:56.971696 29108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:56.938739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39850 (local address 127.11.49.67:34683)
0924 12:57:56.956324 (+ 17585us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:56.956338 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:56.956386 (+ 48us) server_negotiation.cc:407] Connection header received
0924 12:57:56.956529 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:56.956537 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:56.956899 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:56.957199 (+ 300us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:57:56.958169 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.959974 (+ 1805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.963103 (+ 3129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:56.966466 (+ 3363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:56.967565 (+ 1099us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:56.970825 (+ 3260us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:56.970979 (+ 154us) server_negotiation.cc:299] Negotiation successful
0924 12:57:56.971229 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17328,"thread_start_us":17098,"threads_started":1}
I20260924 12:57:56.972626 28894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29ae2de46bd490da5819f99ec30eb7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:57:56.976202 29028 tablet_service.cc:1467] Processing CreateTablet for tablet e29ae2de46bd490da5819f99ec30eb7b (DEFAULT_TABLE table=test-table [id=07c265ba1b5a41aab394557fce423011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:57:56.977954 29028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29ae2de46bd490da5819f99ec30eb7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:57:56.987771 29112 tablet_bootstrap.cc:492] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: Bootstrap starting.
I20260924 12:57:56.993469 29113 tablet_bootstrap.cc:492] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: Bootstrap starting.
I20260924 12:57:56.994545 29112 tablet_bootstrap.cc:654] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: Neither blocks nor log segments found. Creating new log.
I20260924 12:57:56.995939 29114 tablet_bootstrap.cc:492] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: Bootstrap starting.
I20260924 12:57:56.996554 29112 log.cc:824] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: Log is configured to *not* fsync() on all Append() calls
I20260924 12:57:56.998512 29113 tablet_bootstrap.cc:654] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: Neither blocks nor log segments found. Creating new log.
I20260924 12:57:56.999603 29114 tablet_bootstrap.cc:654] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: Neither blocks nor log segments found. Creating new log.
I20260924 12:57:57.000345 29113 log.cc:824] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: Log is configured to *not* fsync() on all Append() calls
I20260924 12:57:57.001663 29114 log.cc:824] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: Log is configured to *not* fsync() on all Append() calls
I20260924 12:57:57.001784 29112 tablet_bootstrap.cc:492] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: No bootstrap required, opened a new log
I20260924 12:57:57.002295 29112 ts_tablet_manager.cc:1397] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.003s
I20260924 12:57:57.005192 29113 tablet_bootstrap.cc:492] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: No bootstrap required, opened a new log
I20260924 12:57:57.005542 29113 ts_tablet_manager.cc:1397] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.005s
I20260924 12:57:57.005805 29114 tablet_bootstrap.cc:492] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: No bootstrap required, opened a new log
I20260924 12:57:57.006207 29114 ts_tablet_manager.cc:1397] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260924 12:57:57.013015 29113 raft_consensus.cc:348] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bf05eed88942f7b681f6a408303346" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 34683 } } peers { permanent_uuid: "44920d4f58b04a45a23cdae3afaf4702" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45211 } } peers { permanent_uuid: "2acc7de738084e868bee9484dcd4bf45" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 42557 } }
I20260924 12:57:57.013819 29113 raft_consensus.cc:374] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:57:57.013983 29113 raft_consensus.cc:729] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2acc7de738084e868bee9484dcd4bf45, State: Initialized, Role: FOLLOWER
I20260924 12:57:57.014843 29113 consensus_queue.cc:260] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bf05eed88942f7b681f6a408303346" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 34683 } } peers { permanent_uuid: "44920d4f58b04a45a23cdae3afaf4702" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45211 } } peers { permanent_uuid: "2acc7de738084e868bee9484dcd4bf45" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 42557 } }
I20260924 12:57:57.015633 29112 raft_consensus.cc:348] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bf05eed88942f7b681f6a408303346" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 34683 } } peers { permanent_uuid: "44920d4f58b04a45a23cdae3afaf4702" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45211 } } peers { permanent_uuid: "2acc7de738084e868bee9484dcd4bf45" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 42557 } }
I20260924 12:57:57.016176 28959 heartbeater.cc:503] Master 127.11.49.126:41649 was elected leader, sending a full tablet report...
I20260924 12:57:57.016536 29112 raft_consensus.cc:374] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:57:57.016817 29112 raft_consensus.cc:729] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44920d4f58b04a45a23cdae3afaf4702, State: Initialized, Role: FOLLOWER
I20260924 12:57:57.016973 29113 ts_tablet_manager.cc:1428] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260924 12:57:57.017891 29112 consensus_queue.cc:260] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bf05eed88942f7b681f6a408303346" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 34683 } } peers { permanent_uuid: "44920d4f58b04a45a23cdae3afaf4702" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45211 } } peers { permanent_uuid: "2acc7de738084e868bee9484dcd4bf45" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 42557 } }
I20260924 12:57:57.018886 29114 raft_consensus.cc:348] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bf05eed88942f7b681f6a408303346" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 34683 } } peers { permanent_uuid: "44920d4f58b04a45a23cdae3afaf4702" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45211 } } peers { permanent_uuid: "2acc7de738084e868bee9484dcd4bf45" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 42557 } }
I20260924 12:57:57.019543 29114 raft_consensus.cc:374] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:57:57.019665 29114 raft_consensus.cc:729] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76bf05eed88942f7b681f6a408303346, State: Initialized, Role: FOLLOWER
I20260924 12:57:57.020498 29112 ts_tablet_manager.cc:1428] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: Time spent starting tablet: real 0.018s user 0.016s sys 0.001s
I20260924 12:57:57.020680 29114 consensus_queue.cc:260] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bf05eed88942f7b681f6a408303346" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 34683 } } peers { permanent_uuid: "44920d4f58b04a45a23cdae3afaf4702" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45211 } } peers { permanent_uuid: "2acc7de738084e868bee9484dcd4bf45" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 42557 } }
I20260924 12:57:57.022749 29093 heartbeater.cc:503] Master 127.11.49.126:41649 was elected leader, sending a full tablet report...
I20260924 12:57:57.023239 29114 ts_tablet_manager.cc:1428] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: Time spent starting tablet: real 0.017s user 0.014s sys 0.004s
W20260924 12:57:57.041584 28826 tablet.cc:2369] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:57:57.078564 29118 raft_consensus.cc:482] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:57:57.079000 29118 raft_consensus.cc:504] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bf05eed88942f7b681f6a408303346" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 34683 } } peers { permanent_uuid: "44920d4f58b04a45a23cdae3afaf4702" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45211 } } peers { permanent_uuid: "2acc7de738084e868bee9484dcd4bf45" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 42557 } }
I20260924 12:57:57.081010 29118 leader_election.cc:288] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76bf05eed88942f7b681f6a408303346 (127.11.49.67:34683), 44920d4f58b04a45a23cdae3afaf4702 (127.11.49.65:45211)
I20260924 12:57:57.090027 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:57.081625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:58927 (local address 127.11.49.65:45211)
0924 12:57:57.081908 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:57.081919 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:57.082734 (+ 815us) server_negotiation.cc:407] Connection header received
0924 12:57:57.083000 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:57.083029 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:57.083118 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:57.083280 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:57:57.084035 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.084896 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.087876 (+ 2980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.088776 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.088916 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:57.088979 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:57.089543 (+ 564us) server_negotiation.cc:299] Negotiation successful
0924 12:57:57.089719 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260924 12:57:57.090287 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:57.081517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45211 (local address 127.11.49.66:58927)
0924 12:57:57.082595 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:57.082620 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:57.082832 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:57.083293 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:57.083297 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:57.083316 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:57:57.083862 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:57.083872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.085081 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.085089 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:57.087675 (+ 2586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:57.087696 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.089083 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.089094 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:57.089295 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:57.089351 (+ 56us) client_negotiation.cc:769] Sending connection context
0924 12:57:57.089500 (+ 149us) client_negotiation.cc:240] Negotiation successful
0924 12:57:57.089752 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"mutex_wait_us":78,"thread_start_us":672,"threads_started":1}
I20260924 12:57:57.090910 29108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:57.081818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:49793 (local address 127.11.49.67:34683)
0924 12:57:57.082111 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:57.082119 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:57.083070 (+ 951us) server_negotiation.cc:407] Connection header received
0924 12:57:57.083262 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:57.083268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:57.083350 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:57.083450 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:57:57.084405 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.085658 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.088061 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.089523 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.089726 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:57.089805 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:57.090472 (+ 667us) server_negotiation.cc:299] Negotiation successful
0924 12:57:57.090695 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260924 12:57:57.091605 29122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:57.081803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:34683 (local address 127.11.49.66:49793)
0924 12:57:57.082916 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:57.082934 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:57.083108 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:57.083590 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:57.083596 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:57.083628 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:57:57.084130 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:57.084145 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.085894 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.085898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:57.087759 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:57.087801 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.089913 (+ 2112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.089920 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:57.090155 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:57.090203 (+ 48us) client_negotiation.cc:769] Sending connection context
0924 12:57:57.091138 (+ 935us) client_negotiation.cc:240] Negotiation successful
0924 12:57:57.091263 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":995,"mutex_wait_us":31,"thread_start_us":660,"threads_started":1}
I20260924 12:57:57.091681 28780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29ae2de46bd490da5819f99ec30eb7b" candidate_uuid: "2acc7de738084e868bee9484dcd4bf45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44920d4f58b04a45a23cdae3afaf4702" is_pre_election: true
I20260924 12:57:57.092551 28780 raft_consensus.cc:2454] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2acc7de738084e868bee9484dcd4bf45 in term 0.
I20260924 12:57:57.093078 29048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29ae2de46bd490da5819f99ec30eb7b" candidate_uuid: "2acc7de738084e868bee9484dcd4bf45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76bf05eed88942f7b681f6a408303346" is_pre_election: true
I20260924 12:57:57.093549 28847 leader_election.cc:302] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2acc7de738084e868bee9484dcd4bf45, 44920d4f58b04a45a23cdae3afaf4702; no voters:
I20260924 12:57:57.093811 29048 raft_consensus.cc:2454] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2acc7de738084e868bee9484dcd4bf45 in term 0.
I20260924 12:57:57.094163 29118 raft_consensus.cc:2781] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260924 12:57:57.094260 29094 tablet.cc:2369] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:57:57.094312 29118 raft_consensus.cc:482] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:57:57.094399 29118 raft_consensus.cc:3037] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:57:57.098445 29118 raft_consensus.cc:504] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bf05eed88942f7b681f6a408303346" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 34683 } } peers { permanent_uuid: "44920d4f58b04a45a23cdae3afaf4702" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45211 } } peers { permanent_uuid: "2acc7de738084e868bee9484dcd4bf45" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 42557 } }
I20260924 12:57:57.099491 29118 leader_election.cc:288] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [CANDIDATE]: Term 1 election: Requested vote from peers 76bf05eed88942f7b681f6a408303346 (127.11.49.67:34683), 44920d4f58b04a45a23cdae3afaf4702 (127.11.49.65:45211)
I20260924 12:57:57.100090 29048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29ae2de46bd490da5819f99ec30eb7b" candidate_uuid: "2acc7de738084e868bee9484dcd4bf45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76bf05eed88942f7b681f6a408303346"
I20260924 12:57:57.100391 29048 raft_consensus.cc:3037] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:57:57.100466 28780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29ae2de46bd490da5819f99ec30eb7b" candidate_uuid: "2acc7de738084e868bee9484dcd4bf45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44920d4f58b04a45a23cdae3afaf4702"
I20260924 12:57:57.100822 28780 raft_consensus.cc:3037] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:57:57.102942 29048 raft_consensus.cc:2454] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2acc7de738084e868bee9484dcd4bf45 in term 1.
I20260924 12:57:57.103609 28850 leader_election.cc:302] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2acc7de738084e868bee9484dcd4bf45, 76bf05eed88942f7b681f6a408303346; no voters:
I20260924 12:57:57.104007 28780 raft_consensus.cc:2454] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2acc7de738084e868bee9484dcd4bf45 in term 1.
I20260924 12:57:57.104254 29118 raft_consensus.cc:2781] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:57:57.104974 29118 raft_consensus.cc:686] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 1 LEADER]: Becoming Leader. State: Replica: 2acc7de738084e868bee9484dcd4bf45, State: Running, Role: LEADER
I20260924 12:57:57.105640 29118 consensus_queue.cc:237] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bf05eed88942f7b681f6a408303346" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 34683 } } peers { permanent_uuid: "44920d4f58b04a45a23cdae3afaf4702" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45211 } } peers { permanent_uuid: "2acc7de738084e868bee9484dcd4bf45" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 42557 } }
I20260924 12:57:57.111814 28636 catalog_manager.cc:5495] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2acc7de738084e868bee9484dcd4bf45 (127.11.49.66). New cstate: current_term: 1 leader_uuid: "2acc7de738084e868bee9484dcd4bf45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bf05eed88942f7b681f6a408303346" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 34683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44920d4f58b04a45a23cdae3afaf4702" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2acc7de738084e868bee9484dcd4bf45" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 42557 } health_report { overall_health: HEALTHY } } }
W20260924 12:57:57.133155 28960 tablet.cc:2369] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:57:57.162285 29111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:57.156007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42662 (local address 127.11.49.66:42557)
0924 12:57:57.156354 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:57.156360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:57.156445 (+ 85us) server_negotiation.cc:407] Connection header received
0924 12:57:57.156729 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:57.156733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:57.156822 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:57.156969 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:57:57.157500 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.158264 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.159838 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.160243 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.160440 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:57.161025 (+ 585us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:57:57.161579 (+ 554us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:57:57.161751 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:57.161877 (+ 126us) server_negotiation.cc:299] Negotiation successful
0924 12:57:57.161960 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260924 12:57:57.173262 28780 raft_consensus.cc:1261] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702 [term 1 FOLLOWER]: Refusing update from remote peer 2acc7de738084e868bee9484dcd4bf45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:57:57.173262 29048 raft_consensus.cc:1261] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346 [term 1 FOLLOWER]: Refusing update from remote peer 2acc7de738084e868bee9484dcd4bf45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:57:57.174654 29123 consensus_queue.cc:1035] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76bf05eed88942f7b681f6a408303346" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 34683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:57:57.175364 29118 consensus_queue.cc:1035] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44920d4f58b04a45a23cdae3afaf4702" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:57:57.193246 29128 mvcc.cc:205] Tried to move back new op lower bound from 7332883157686980608 to 7332883157430018048. Current Snapshot: MvccSnapshot[applied={T|T < 7332883157686980608}]
I20260924 12:57:57.213886 28635 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:57:57.214359 28635 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:57:57.219980 28635 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 00f1fff37cb342349557a57a44dd9a81: Sending DeleteTablet for 3 replicas of tablet e29ae2de46bd490da5819f99ec30eb7b
I20260924 12:57:57.221786 28760 tablet_service.cc:1514] Processing DeleteTablet for tablet e29ae2de46bd490da5819f99ec30eb7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:57:57 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:46184
I20260924 12:57:57.221786 29028 tablet_service.cc:1514] Processing DeleteTablet for tablet e29ae2de46bd490da5819f99ec30eb7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:57:57 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:39850
I20260924 12:57:57.222183 28894 tablet_service.cc:1514] Processing DeleteTablet for tablet e29ae2de46bd490da5819f99ec30eb7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:57:57 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:42648
I20260924 12:57:57.229017 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 28697
I20260924 12:57:57.235143 29137 tablet_replica.cc:330] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: stopping tablet replica
I20260924 12:57:57.235908 29137 raft_consensus.cc:2229] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:57:57.236716 29137 raft_consensus.cc:2258] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:57:57.241715 29137 ts_tablet_manager.cc:1905] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:57:57.248855 29136 tablet_replica.cc:330] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: stopping tablet replica
I20260924 12:57:57.249468 29136 raft_consensus.cc:2229] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:57:57.250128 29136 raft_consensus.cc:2258] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:57:57.253237 29136 ts_tablet_manager.cc:1905] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:57:57.261711 29136 ts_tablet_manager.cc:1918] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:57:57.262104 29136 log.cc:1196] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/e29ae2de46bd490da5819f99ec30eb7b
I20260924 12:57:57.263386 29138 tablet_replica.cc:330] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: stopping tablet replica
I20260924 12:57:57.263681 29136 ts_tablet_manager.cc:1939] T e29ae2de46bd490da5819f99ec30eb7b P 44920d4f58b04a45a23cdae3afaf4702: Deleting consensus metadata
I20260924 12:57:57.264072 29138 raft_consensus.cc:2229] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:57:57.265007 29138 raft_consensus.cc:2258] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:57:57.265045 29137 ts_tablet_manager.cc:1918] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:57:57.265286 29137 log.cc:1196] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/e29ae2de46bd490da5819f99ec30eb7b
I20260924 12:57:57.265926 29137 ts_tablet_manager.cc:1939] T e29ae2de46bd490da5819f99ec30eb7b P 76bf05eed88942f7b681f6a408303346: Deleting consensus metadata
I20260924 12:57:57.267364 28620 catalog_manager.cc:4841] TS 44920d4f58b04a45a23cdae3afaf4702 (127.11.49.65:45211): tablet e29ae2de46bd490da5819f99ec30eb7b (table test-table [id=07c265ba1b5a41aab394557fce423011]) successfully deleted
I20260924 12:57:57.268218 28623 catalog_manager.cc:4841] TS 76bf05eed88942f7b681f6a408303346 (127.11.49.67:34683): tablet e29ae2de46bd490da5819f99ec30eb7b (table test-table [id=07c265ba1b5a41aab394557fce423011]) successfully deleted
Sep 24 12:57:57 dist-test-slave-m9hg krb5kdc[28591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:57:57.270347 29138 ts_tablet_manager.cc:1905] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:57:57.278887 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:57.231931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46200 (local address 127.11.49.65:45211)
0924 12:57:57.232234 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:57.232245 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:57.238905 (+ 6660us) server_negotiation.cc:407] Connection header received
0924 12:57:57.244907 (+ 6002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:57.244919 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:57.245090 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:57.245225 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:57.252523 (+ 7298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.253775 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.260512 (+ 6737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.261295 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.261429 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:57.270978 (+ 9549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:57.270999 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:57.271019 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:57.271084 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:57.275123 (+ 4039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:57.276230 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:57.276239 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:57.276242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:57.276481 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:57.276933 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:57.276939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:57.276941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:57.277401 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:57.277768 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:57.278134 (+ 366us) server_negotiation.cc:299] Negotiation successful
0924 12:57:57.278419 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260924 12:57:57.279373 29138 ts_tablet_manager.cc:1918] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:57:57.279599 29138 log.cc:1196] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/e29ae2de46bd490da5819f99ec30eb7b
I20260924 12:57:57.279984 28820 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:57:57.280313 29138 ts_tablet_manager.cc:1939] T e29ae2de46bd490da5819f99ec30eb7b P 2acc7de738084e868bee9484dcd4bf45: Deleting consensus metadata
I20260924 12:57:57.282488 28621 catalog_manager.cc:4841] TS 2acc7de738084e868bee9484dcd4bf45 (127.11.49.66:42557): tablet e29ae2de46bd490da5819f99ec30eb7b (table test-table [id=07c265ba1b5a41aab394557fce423011]) successfully deleted
I20260924 12:57:57.386777 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 28697
I20260924 12:57:57.413273 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 28831
Sep 24 12:57:57 dist-test-slave-m9hg krb5kdc[28591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:57:57.435485 29111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:57.414548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42668 (local address 127.11.49.66:42557)
0924 12:57:57.414761 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:57.414766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:57.414790 (+ 24us) server_negotiation.cc:407] Connection header received
0924 12:57:57.414867 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:57.414871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:57.414966 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:57.415077 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:57.417122 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.418337 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.420701 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.421271 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.421443 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:57.427626 (+ 6183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:57.427659 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:57.427682 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:57.427754 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:57.431684 (+ 3930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:57.432890 (+ 1206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:57.432899 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:57.432902 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:57.433114 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:57.433569 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:57.433573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:57.433576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:57.434046 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:57.434495 (+ 449us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:57.434761 (+ 266us) server_negotiation.cc:299] Negotiation successful
0924 12:57:57.435050 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260924 12:57:57.436542 28954 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:57:57.578953 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 28831
I20260924 12:57:57.603605 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 28965
Sep 24 12:57:57 dist-test-slave-m9hg krb5kdc[28591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:57:57.631309 29142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:57.604704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39854 (local address 127.11.49.67:34683)
0924 12:57:57.605384 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:57.605389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:57.605414 (+ 25us) server_negotiation.cc:407] Connection header received
0924 12:57:57.605494 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:57.605500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:57.605588 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:57.605720 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:57.607562 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.608577 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.610292 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:57.611059 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:57.611217 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:57.621394 (+ 10177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:57.621427 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:57.621455 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:57:57.621537 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:57.627176 (+ 5639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:57.628438 (+ 1262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:57.628451 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:57.628456 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:57.628727 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:57:57.629229 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:57:57.629235 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:57:57.629239 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:57:57.629808 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:57.630178 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:57.630485 (+ 307us) server_negotiation.cc:299] Negotiation successful
0924 12:57:57.630821 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":378,"threads_started":1}
I20260924 12:57:57.632467 29088 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:57:57.755621 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 28965
I20260924 12:57:57.775655 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 28604
I20260924 12:57:57.777134 28666 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:57:57.911442 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 28604
2026-09-24T12:57:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5315 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-24T12:57:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:57:57Z Disabled control of system clock
I20260924 12:57:58.005136 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:37379
--webserver_interface=127.11.49.126
--webserver_port=0
--builtin_ntp_servers=127.11.49.84:41167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:37379
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 12:57:58.415519 29148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:58.415973 29148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:58.416200 29148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:58.425355 29148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:57:58.425556 29148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:58.425599 29148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:58.425664 29148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:57:58.425705 29148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:57:58.437808 29148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:37379
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:37379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:58.439952 29148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:58.443288 29148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:58.458945 29153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:58.458974 29154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:58.458895 29156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:58.462594 29148 server_base.cc:1034] running on GCE node
I20260924 12:57:58.463975 29148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:58.466219 29148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:58.467516 29148 hybrid_clock.cc:648] HybridClock initialized: now 1790254678467438 us; error 69 us; skew 500 ppm
I20260924 12:57:58.468050 29148 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:57:58.477532 29148 webserver.cc:460] Webserver started at http://127.11.49.126:37735/ using document root <none> and password file <none>
I20260924 12:57:58.478605 29148 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:58.478731 29148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:58.479189 29148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:57:58.483299 29148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "b1f5e06259c04a6193ef661fe40eed86"
format_stamp: "Formatted at 2026-09-24 12:57:58 on dist-test-slave-m9hg"
server_key: "c59fce3c9cb65dd7035b79f0a206abb8"
server_key_iv: "26e73e8adc41514660837d75e68fafbe"
server_key_version: "encryptionkey@0"
I20260924 12:57:58.484568 29148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "b1f5e06259c04a6193ef661fe40eed86"
format_stamp: "Formatted at 2026-09-24 12:57:58 on dist-test-slave-m9hg"
server_key: "c59fce3c9cb65dd7035b79f0a206abb8"
server_key_iv: "26e73e8adc41514660837d75e68fafbe"
server_key_version: "encryptionkey@0"
I20260924 12:57:58.491998 29148 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260924 12:57:58.497752 29162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:58.499884 29148 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260924 12:57:58.500247 29148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "b1f5e06259c04a6193ef661fe40eed86"
format_stamp: "Formatted at 2026-09-24 12:57:58 on dist-test-slave-m9hg"
server_key: "c59fce3c9cb65dd7035b79f0a206abb8"
server_key_iv: "26e73e8adc41514660837d75e68fafbe"
server_key_version: "encryptionkey@0"
I20260924 12:57:58.500667 29148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:58.531105 29148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:58.532393 29148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:58.532771 29148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:58.556694 29148 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:37379
I20260924 12:57:58.556725 29213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:37379 every 8 connection(s)
I20260924 12:57:58.558615 29148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:57:58.563429 29214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:57:58.565891 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 29148
I20260924 12:57:58.566187 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:57:58.566709 11461 external_mini_cluster.cc:1428] Setting key efb5e416b69c77fd297153da882c8192
I20260924 12:57:58.577580 29214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86: Bootstrap starting.
I20260924 12:57:58.581488 29214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86: Neither blocks nor log segments found. Creating new log.
I20260924 12:57:58.582895 29214 log.cc:824] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86: Log is configured to *not* fsync() on all Append() calls
I20260924 12:57:58.585484 29217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:58.569105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45216 (local address 127.11.49.126:37379)
0924 12:57:58.570660 (+ 1555us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:58.570677 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:58.570737 (+ 60us) server_negotiation.cc:407] Connection header received
0924 12:57:58.573283 (+ 2546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:58.573322 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:58.574099 (+ 777us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:58.574705 (+ 606us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:58.575528 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:58.577123 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:58.578829 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:58.579722 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:58.579976 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:58.581733 (+ 1757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:58.581746 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:58.581775 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:57:58.582633 (+ 858us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:58.582766 (+ 133us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:57:58.582796 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:58.582974 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:58.583239 (+ 265us) server_negotiation.cc:299] Negotiation successful
0924 12:57:58.583802 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":906,"thread_start_us":554,"threads_started":1}
I20260924 12:57:58.587266 29214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86: No bootstrap required, opened a new log
I20260924 12:57:58.595427 29214 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f5e06259c04a6193ef661fe40eed86" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37379 } }
I20260924 12:57:58.595930 29214 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:57:58.596076 29214 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5e06259c04a6193ef661fe40eed86, State: Initialized, Role: FOLLOWER
I20260924 12:57:58.596818 29214 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f5e06259c04a6193ef661fe40eed86" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37379 } }
I20260924 12:57:58.597071 29214 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:57:58.597235 29214 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:57:58.597433 29214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:57:58.599726 29214 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f5e06259c04a6193ef661fe40eed86" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37379 } }
I20260924 12:57:58.600394 29214 leader_election.cc:302] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1f5e06259c04a6193ef661fe40eed86; no voters:
I20260924 12:57:58.601143 29214 leader_election.cc:288] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:57:58.601504 29219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:57:58.602512 29219 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5e06259c04a6193ef661fe40eed86, State: Running, Role: LEADER
I20260924 12:57:58.603413 29219 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f5e06259c04a6193ef661fe40eed86" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37379 } }
I20260924 12:57:58.603823 29214 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:57:58.607918 29221 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1f5e06259c04a6193ef661fe40eed86. Latest consensus state: current_term: 1 leader_uuid: "b1f5e06259c04a6193ef661fe40eed86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f5e06259c04a6193ef661fe40eed86" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37379 } } }
I20260924 12:57:58.608510 29221 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [sys.catalog]: This master's current role is: LEADER
I20260924 12:57:58.608843 29220 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1f5e06259c04a6193ef661fe40eed86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f5e06259c04a6193ef661fe40eed86" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37379 } } }
I20260924 12:57:58.609328 29220 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86 [sys.catalog]: This master's current role is: LEADER
I20260924 12:57:58.616128 29226 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:57:58.623654 29226 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:57:58.636101 29226 catalog_manager.cc:1347] Generated new cluster ID: daa07f81858f46b19e843362d038780f
I20260924 12:57:58.636312 29226 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:57:58.646906 29226 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:57:58.648468 29226 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:57:58.663208 29226 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86: Generated new TSK 0
I20260924 12:57:58.664372 29226 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:57:58.673271 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37379
--builtin_ntp_servers=127.11.49.84:41167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 12:57:59.046687 29238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:59.047005 29238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:59.047096 29238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:59.054878 29238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:59.055004 29238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:59.055197 29238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:57:59.064939 29238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37379
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:59.066318 29238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:59.068204 29238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:59.083438 29246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:59.083664 29243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:59.083635 29244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:59.085305 29238 server_base.cc:1034] running on GCE node
I20260924 12:57:59.086120 29238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:59.087322 29238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:59.088601 29238 hybrid_clock.cc:648] HybridClock initialized: now 1790254679088536 us; error 70 us; skew 500 ppm
I20260924 12:57:59.088997 29238 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:57:59.091950 29238 webserver.cc:460] Webserver started at http://127.11.49.65:36655/ using document root <none> and password file <none>
I20260924 12:57:59.092840 29238 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:59.092991 29238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:59.093343 29238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:57:59.096745 29238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "02013e6561ae4015867cc01f798ce63a"
format_stamp: "Formatted at 2026-09-24 12:57:59 on dist-test-slave-m9hg"
server_key: "c5378b607934211eba1316d9c5c36e26"
server_key_iv: "8326eb7a00e607a67f975bedb2aff07b"
server_key_version: "encryptionkey@0"
I20260924 12:57:59.097652 29238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "02013e6561ae4015867cc01f798ce63a"
format_stamp: "Formatted at 2026-09-24 12:57:59 on dist-test-slave-m9hg"
server_key: "c5378b607934211eba1316d9c5c36e26"
server_key_iv: "8326eb7a00e607a67f975bedb2aff07b"
server_key_version: "encryptionkey@0"
I20260924 12:57:59.104099 29238 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260924 12:57:59.109064 29252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:59.110952 29238 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:57:59.111284 29238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "02013e6561ae4015867cc01f798ce63a"
format_stamp: "Formatted at 2026-09-24 12:57:59 on dist-test-slave-m9hg"
server_key: "c5378b607934211eba1316d9c5c36e26"
server_key_iv: "8326eb7a00e607a67f975bedb2aff07b"
server_key_version: "encryptionkey@0"
I20260924 12:57:59.111577 29238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:59.130715 29238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:59.131680 29238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:59.132033 29238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:59.133478 29238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:57:59.135264 29238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:57:59.135406 29238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:59.135560 29238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:57:59.135659 29238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:59.178406 29238 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:41631
I20260924 12:57:59.178532 29364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:41631 every 8 connection(s)
I20260924 12:57:59.179934 29238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:57:59.184708 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 29238
I20260924 12:57:59.184954 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:57:59.185501 11461 external_mini_cluster.cc:1428] Setting key ef1da14a531e0b3490393cf3efe9440c
I20260924 12:57:59.189607 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37379
--builtin_ntp_servers=127.11.49.84:41167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260924 12:57:59.196696 29367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:59.183627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:56873 (local address 127.11.49.126:37379)
0924 12:57:59.184368 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:59.184379 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:59.186213 (+ 1834us) server_negotiation.cc:407] Connection header received
0924 12:57:59.187961 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:59.187968 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:59.188086 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:59.188295 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:59.189541 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:59.190830 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:59.192701 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:59.193463 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:59.193657 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:59.195303 (+ 1646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:59.195313 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:59.195320 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:57:59.195356 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:59.195437 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:57:59.195457 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:59.195571 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:59.195974 (+ 403us) server_negotiation.cc:299] Negotiation successful
0924 12:57:59.196133 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":291,"threads_started":1}
I20260924 12:57:59.197568 29368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:59.184240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:37379 (local address 127.11.49.65:56873)
0924 12:57:59.185452 (+ 1212us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:59.185498 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:59.187581 (+ 2083us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:59.188557 (+ 976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:59.188565 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:59.188666 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:57:59.189301 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:59.189318 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:59.191054 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:59.191058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:59.192519 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:59.192533 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:59.193808 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:59.193815 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:59.194037 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:59.194894 (+ 857us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:57:59.194897 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:57:59.194938 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:57:59.195026 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:57:59.195621 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:57:59.195631 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:57:59.195638 (+ 7us) client_negotiation.cc:769] Sending connection context
0924 12:57:59.195902 (+ 264us) client_negotiation.cc:240] Negotiation successful
0924 12:57:59.196264 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":387,"threads_started":1}
I20260924 12:57:59.199570 29365 heartbeater.cc:347] Connected to a master server at 127.11.49.126:37379
I20260924 12:57:59.199925 29365 heartbeater.cc:464] Registering TS with master...
I20260924 12:57:59.200871 29365 heartbeater.cc:511] Master 127.11.49.126:37379 requested a full tablet report, sending...
I20260924 12:57:59.203495 29179 ts_manager.cc:194] Registered new tserver with Master: 02013e6561ae4015867cc01f798ce63a (127.11.49.65:41631)
I20260924 12:57:59.205825 29179 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.65:56873
W20260924 12:57:59.556869 29369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:57:59.557235 29369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:57:59.557407 29369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:57:59.565376 29369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:57:59.565536 29369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:57:59.565742 29369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:57:59.575273 29369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37379
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:57:59.576726 29369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:57:59.578502 29369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:57:59.596833 29375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:59.596853 29374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:57:59.597407 29377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:57:59.597882 29369 server_base.cc:1034] running on GCE node
I20260924 12:57:59.598560 29369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:57:59.599603 29369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:57:59.600914 29369 hybrid_clock.cc:648] HybridClock initialized: now 1790254679600844 us; error 69 us; skew 500 ppm
I20260924 12:57:59.601341 29369 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:57:59.604432 29369 webserver.cc:460] Webserver started at http://127.11.49.66:43049/ using document root <none> and password file <none>
I20260924 12:57:59.605333 29369 fs_manager.cc:359] Metadata directory not provided
I20260924 12:57:59.605468 29369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:57:59.605793 29369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:57:59.609077 29369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "63846d4150e64daa878f3d284762df90"
format_stamp: "Formatted at 2026-09-24 12:57:59 on dist-test-slave-m9hg"
server_key: "aee0425a524893824db1275609ba26dd"
server_key_iv: "6182ed0bd8595b735a32f7dd10f12b97"
server_key_version: "encryptionkey@0"
I20260924 12:57:59.609915 29369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "63846d4150e64daa878f3d284762df90"
format_stamp: "Formatted at 2026-09-24 12:57:59 on dist-test-slave-m9hg"
server_key: "aee0425a524893824db1275609ba26dd"
server_key_iv: "6182ed0bd8595b735a32f7dd10f12b97"
server_key_version: "encryptionkey@0"
I20260924 12:57:59.615948 29369 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260924 12:57:59.620386 29383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:59.622076 29369 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:57:59.622359 29369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "63846d4150e64daa878f3d284762df90"
format_stamp: "Formatted at 2026-09-24 12:57:59 on dist-test-slave-m9hg"
server_key: "aee0425a524893824db1275609ba26dd"
server_key_iv: "6182ed0bd8595b735a32f7dd10f12b97"
server_key_version: "encryptionkey@0"
I20260924 12:57:59.622623 29369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:57:59.641299 29369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:57:59.642254 29369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:57:59.642613 29369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:57:59.643836 29369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:57:59.645691 29369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:57:59.645833 29369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:59.645987 29369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:57:59.646085 29369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:57:59.688416 29369 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:34291
I20260924 12:57:59.688635 29495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:34291 every 8 connection(s)
I20260924 12:57:59.689898 29369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:57:59.696975 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 29369
I20260924 12:57:59.697181 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:57:59.697674 11461 external_mini_cluster.cc:1428] Setting key 84ca68707862b9a8679b0d7c23900cf7
I20260924 12:57:59.701417 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37379
--builtin_ntp_servers=127.11.49.84:41167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260924 12:57:59.707701 29367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:59.693521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:43357 (local address 127.11.49.126:37379)
0924 12:57:59.693798 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0924 12:57:59.693804 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:57:59.695518 (+ 1714us) server_negotiation.cc:407] Connection header received
0924 12:57:59.698178 (+ 2660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:57:59.698186 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:57:59.698313 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:57:59.698444 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:57:59.700571 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:59.701469 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:59.703555 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:57:59.704121 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:57:59.704386 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:59.706578 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:57:59.706584 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:57:59.706588 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:57:59.706616 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:57:59.706662 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:57:59.706678 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:57:59.706801 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0924 12:57:59.707120 (+ 319us) server_negotiation.cc:299] Negotiation successful
0924 12:57:59.707278 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260924 12:57:59.709447 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:57:59.694000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:37379 (local address 127.11.49.66:43357)
0924 12:57:59.695265 (+ 1265us) negotiation.cc:107] Waiting for socket to connect
0924 12:57:59.695317 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0924 12:57:59.697704 (+ 2387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:57:59.698823 (+ 1119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:57:59.698840 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:57:59.699008 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:57:59.700256 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:59.700364 (+ 108us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:59.701682 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:59.701689 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:59.703328 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:57:59.703348 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:57:59.704486 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:57:59.704495 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:57:59.704879 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:57:59.706028 (+ 1149us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:57:59.706031 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:57:59.706105 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:57:59.706234 (+ 129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:57:59.706801 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:57:59.706817 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:57:59.706831 (+ 14us) client_negotiation.cc:769] Sending connection context
0924 12:57:59.707094 (+ 263us) client_negotiation.cc:240] Negotiation successful
0924 12:57:59.707742 (+ 648us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":374,"threads_started":1}
I20260924 12:57:59.711455 29496 heartbeater.cc:347] Connected to a master server at 127.11.49.126:37379
I20260924 12:57:59.711961 29496 heartbeater.cc:464] Registering TS with master...
I20260924 12:57:59.713357 29496 heartbeater.cc:511] Master 127.11.49.126:37379 requested a full tablet report, sending...
I20260924 12:57:59.715724 29179 ts_manager.cc:194] Registered new tserver with Master: 63846d4150e64daa878f3d284762df90 (127.11.49.66:34291)
I20260924 12:57:59.716836 29179 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.66:43357
W20260924 12:58:00.135880 29499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:00.136324 29499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:00.136513 29499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:00.145231 29499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:00.145480 29499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:00.145704 29499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:58:00.156553 29499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37379
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:00.158514 29499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:00.161512 29499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:00.179399 29505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:00.180333 29504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:00.181066 29507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:00.181545 29499 server_base.cc:1034] running on GCE node
I20260924 12:58:00.182337 29499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:00.183597 29499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:00.184945 29499 hybrid_clock.cc:648] HybridClock initialized: now 1790254680184884 us; error 62 us; skew 500 ppm
I20260924 12:58:00.185381 29499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:58:00.188455 29499 webserver.cc:460] Webserver started at http://127.11.49.67:41949/ using document root <none> and password file <none>
I20260924 12:58:00.189244 29499 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:00.189388 29499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:00.189731 29499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:00.193157 29499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "5590aa254bbb4187b9170a6aa929f7ec"
format_stamp: "Formatted at 2026-09-24 12:58:00 on dist-test-slave-m9hg"
server_key: "6f899104e33dd51508eea283088712b8"
server_key_iv: "8b4ed6b1d2cddb1b90857ae83ad24489"
server_key_version: "encryptionkey@0"
I20260924 12:58:00.194031 29499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "5590aa254bbb4187b9170a6aa929f7ec"
format_stamp: "Formatted at 2026-09-24 12:58:00 on dist-test-slave-m9hg"
server_key: "6f899104e33dd51508eea283088712b8"
server_key_iv: "8b4ed6b1d2cddb1b90857ae83ad24489"
server_key_version: "encryptionkey@0"
I20260924 12:58:00.200141 29499 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260924 12:58:00.204757 29513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:00.206948 29499 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:58:00.207222 29499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "5590aa254bbb4187b9170a6aa929f7ec"
format_stamp: "Formatted at 2026-09-24 12:58:00 on dist-test-slave-m9hg"
server_key: "6f899104e33dd51508eea283088712b8"
server_key_iv: "8b4ed6b1d2cddb1b90857ae83ad24489"
server_key_version: "encryptionkey@0"
I20260924 12:58:00.207507 29499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:00.210356 29365 heartbeater.cc:503] Master 127.11.49.126:37379 was elected leader, sending a full tablet report...
I20260924 12:58:00.240411 29499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:00.241312 29499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:00.241585 29499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:00.242677 29499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:00.244413 29499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:00.244513 29499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:00.244597 29499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:00.244673 29499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:00.287117 29499 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:42327
I20260924 12:58:00.287277 29625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:42327 every 8 connection(s)
I20260924 12:58:00.288663 29499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:58:00.289486 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 29499
I20260924 12:58:00.289723 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:58:00.290386 11461 external_mini_cluster.cc:1428] Setting key 45a3bb2ec917ff3f22c488a922ad3892
I20260924 12:58:00.305541 29628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.292747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:57787 (local address 127.11.49.126:37379)
0924 12:58:00.293656 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:00.293667 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:00.295265 (+ 1598us) server_negotiation.cc:407] Connection header received
0924 12:58:00.297530 (+ 2265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:00.297535 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:00.297623 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:00.297745 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:00.299156 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.299995 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.301947 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.302407 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.302535 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.304437 (+ 1902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:00.304442 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:00.304446 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:00.304470 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:00.304521 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:00.304535 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:00.304628 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:00.304900 (+ 272us) server_negotiation.cc:299] Negotiation successful
0924 12:58:00.305002 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":596,"threads_started":1}
I20260924 12:58:00.307186 29629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.293654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:37379 (local address 127.11.49.67:57787)
0924 12:58:00.295059 (+ 1405us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:00.295117 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:00.297185 (+ 2068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:00.298018 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:00.298028 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:00.298184 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:00.298945 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.298971 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.300209 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.300214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.301773 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.301788 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.302651 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.302656 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.302918 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.303859 (+ 941us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:58:00.303862 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:00.303920 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:58:00.304028 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:00.304647 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:00.304656 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:00.304663 (+ 7us) client_negotiation.cc:769] Sending connection context
0924 12:58:00.304881 (+ 218us) client_negotiation.cc:240] Negotiation successful
0924 12:58:00.305470 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"thread_start_us":479,"threads_started":1}
I20260924 12:58:00.309011 29626 heartbeater.cc:347] Connected to a master server at 127.11.49.126:37379
I20260924 12:58:00.309448 29626 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:00.310475 29626 heartbeater.cc:511] Master 127.11.49.126:37379 requested a full tablet report, sending...
I20260924 12:58:00.312353 29179 ts_manager.cc:194] Registered new tserver with Master: 5590aa254bbb4187b9170a6aa929f7ec (127.11.49.67:42327)
I20260924 12:58:00.313342 29179 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.67:57787
I20260924 12:58:00.321300 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:58:00.333261 29628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.326016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45220 (local address 127.11.49.126:37379)
0924 12:58:00.326337 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:00.326345 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:00.326707 (+ 362us) server_negotiation.cc:407] Connection header received
0924 12:58:00.327054 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:00.327059 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:00.327175 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:00.327307 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:00.327947 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.328836 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.330364 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.330821 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.330987 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.332401 (+ 1414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:00.332407 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:00.332411 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:00.332436 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:00.332478 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:00.332492 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:00.332599 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:00.332757 (+ 158us) server_negotiation.cc:299] Negotiation successful
0924 12:58:00.332885 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260924 12:58:00.338583 29179 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:58:00.346894 29179 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:58:00.386078 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.363270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:42327 (local address 127.0.0.1:52840)
0924 12:58:00.364572 (+ 1302us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:00.364626 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:00.364865 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:00.377055 (+ 12190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:00.377069 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:00.377128 (+ 59us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:00.377873 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.377889 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.380160 (+ 2271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.380166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.382790 (+ 2624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.382805 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.384797 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.384803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.385051 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.385159 (+ 108us) client_negotiation.cc:769] Sending connection context
0924 12:58:00.385290 (+ 131us) client_negotiation.cc:240] Negotiation successful
0924 12:58:00.385663 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":896,"mutex_wait_us":274,"thread_start_us":12549,"threads_started":1}
I20260924 12:58:00.386368 29642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.364250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40516 (local address 127.11.49.66:34291)
0924 12:58:00.375004 (+ 10754us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:00.375019 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:00.376552 (+ 1533us) server_negotiation.cc:407] Connection header received
0924 12:58:00.376682 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:00.376691 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:00.377001 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:00.377232 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:00.378685 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.380199 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.382990 (+ 2791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.384154 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.384335 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.384688 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:00.385715 (+ 1027us) server_negotiation.cc:299] Negotiation successful
0924 12:58:00.385952 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10469,"thread_start_us":10342,"threads_started":1}
I20260924 12:58:00.387184 29641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.363621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52840 (local address 127.11.49.67:42327)
0924 12:58:00.375849 (+ 12228us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:00.375863 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:00.375928 (+ 65us) server_negotiation.cc:407] Connection header received
0924 12:58:00.376117 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:00.376131 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:00.376585 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:00.377586 (+ 1001us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:00.378337 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.379985 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.383038 (+ 3053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.384574 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.386167 (+ 1593us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.386561 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:00.386662 (+ 101us) server_negotiation.cc:299] Negotiation successful
0924 12:58:00.386853 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11909,"thread_start_us":11624,"threads_started":1}
I20260924 12:58:00.387195 29639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.363529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:34291 (local address 127.0.0.1:40516)
0924 12:58:00.376173 (+ 12644us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:00.376195 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:00.376397 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:00.377259 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:00.377263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:00.377300 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:00.378447 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.378459 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.380440 (+ 1981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.380445 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.382755 (+ 2310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.382769 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.384856 (+ 2087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.384863 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.385142 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.385192 (+ 50us) client_negotiation.cc:769] Sending connection context
0924 12:58:00.385306 (+ 114us) client_negotiation.cc:240] Negotiation successful
0924 12:58:00.385892 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12484,"mutex_wait_us":947,"thread_start_us":1034,"threads_started":1}
I20260924 12:58:00.387717 29643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.365749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:41631 (local address 127.0.0.1:51904)
0924 12:58:00.378493 (+ 12744us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:00.378517 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:00.378653 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:00.379408 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:00.379414 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:00.379445 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:00.379840 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.379851 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.382091 (+ 2240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.382096 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.384328 (+ 2232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.384344 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.386618 (+ 2274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.386624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.386823 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.386875 (+ 52us) client_negotiation.cc:769] Sending connection context
0924 12:58:00.386958 (+ 83us) client_negotiation.cc:240] Negotiation successful
0924 12:58:00.387098 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12559,"thread_start_us":12284,"threads_started":1}
I20260924 12:58:00.388168 29644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.366573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51904 (local address 127.11.49.65:41631)
0924 12:58:00.378079 (+ 11506us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:00.378091 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:00.378783 (+ 692us) server_negotiation.cc:407] Connection header received
0924 12:58:00.378922 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:00.378930 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:00.379179 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:00.379369 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:00.380081 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.381900 (+ 1819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.384600 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.386141 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.386439 (+ 298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.387559 (+ 1120us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:00.387642 (+ 83us) server_negotiation.cc:299] Negotiation successful
0924 12:58:00.387819 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11270,"thread_start_us":11106,"threads_started":1}
I20260924 12:58:00.391634 29431 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5b8b0e87734ddeb553906e5242d794 (DEFAULT_TABLE table=test-table [id=68f60f97c0604de49a4f1bbce626c311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:00.391634 29561 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5b8b0e87734ddeb553906e5242d794 (DEFAULT_TABLE table=test-table [id=68f60f97c0604de49a4f1bbce626c311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:00.393219 29561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5b8b0e87734ddeb553906e5242d794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:00.393219 29431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5b8b0e87734ddeb553906e5242d794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:00.399999 29300 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5b8b0e87734ddeb553906e5242d794 (DEFAULT_TABLE table=test-table [id=68f60f97c0604de49a4f1bbce626c311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:00.401799 29300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5b8b0e87734ddeb553906e5242d794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:00.410404 29645 tablet_bootstrap.cc:492] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: Bootstrap starting.
I20260924 12:58:00.412890 29646 tablet_bootstrap.cc:492] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: Bootstrap starting.
I20260924 12:58:00.415108 29645 tablet_bootstrap.cc:654] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:00.416885 29646 tablet_bootstrap.cc:654] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:00.416841 29645 log.cc:824] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:00.418215 29646 log.cc:824] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:00.421113 29645 tablet_bootstrap.cc:492] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: No bootstrap required, opened a new log
I20260924 12:58:00.421337 29646 tablet_bootstrap.cc:492] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: No bootstrap required, opened a new log
I20260924 12:58:00.421559 29649 tablet_bootstrap.cc:492] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a: Bootstrap starting.
I20260924 12:58:00.421630 29646 ts_tablet_manager.cc:1397] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260924 12:58:00.421777 29645 ts_tablet_manager.cc:1397] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.008s
I20260924 12:58:00.426697 29649 tablet_bootstrap.cc:654] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:00.428082 29649 log.cc:824] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:00.432039 29649 tablet_bootstrap.cc:492] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a: No bootstrap required, opened a new log
I20260924 12:58:00.431945 29645 raft_consensus.cc:348] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5590aa254bbb4187b9170a6aa929f7ec" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42327 } } peers { permanent_uuid: "63846d4150e64daa878f3d284762df90" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34291 } } peers { permanent_uuid: "02013e6561ae4015867cc01f798ce63a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 41631 } }
I20260924 12:58:00.432411 29649 ts_tablet_manager.cc:1397] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260924 12:58:00.432571 29645 raft_consensus.cc:374] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:00.432673 29645 raft_consensus.cc:729] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63846d4150e64daa878f3d284762df90, State: Initialized, Role: FOLLOWER
I20260924 12:58:00.432997 29646 raft_consensus.cc:348] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5590aa254bbb4187b9170a6aa929f7ec" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42327 } } peers { permanent_uuid: "63846d4150e64daa878f3d284762df90" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34291 } } peers { permanent_uuid: "02013e6561ae4015867cc01f798ce63a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 41631 } }
I20260924 12:58:00.433461 29646 raft_consensus.cc:374] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:00.433578 29646 raft_consensus.cc:729] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5590aa254bbb4187b9170a6aa929f7ec, State: Initialized, Role: FOLLOWER
I20260924 12:58:00.433604 29645 consensus_queue.cc:260] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5590aa254bbb4187b9170a6aa929f7ec" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42327 } } peers { permanent_uuid: "63846d4150e64daa878f3d284762df90" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34291 } } peers { permanent_uuid: "02013e6561ae4015867cc01f798ce63a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 41631 } }
I20260924 12:58:00.434345 29646 consensus_queue.cc:260] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5590aa254bbb4187b9170a6aa929f7ec" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42327 } } peers { permanent_uuid: "63846d4150e64daa878f3d284762df90" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34291 } } peers { permanent_uuid: "02013e6561ae4015867cc01f798ce63a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 41631 } }
I20260924 12:58:00.435055 29496 heartbeater.cc:503] Master 127.11.49.126:37379 was elected leader, sending a full tablet report...
I20260924 12:58:00.437518 29645 ts_tablet_manager.cc:1428] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: Time spent starting tablet: real 0.016s user 0.012s sys 0.000s
I20260924 12:58:00.438879 29626 heartbeater.cc:503] Master 127.11.49.126:37379 was elected leader, sending a full tablet report...
I20260924 12:58:00.439538 29646 ts_tablet_manager.cc:1428] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
W20260924 12:58:00.442248 29497 tablet.cc:2369] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:58:00.443957 29652 raft_consensus.cc:482] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:58:00.444348 29652 raft_consensus.cc:504] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5590aa254bbb4187b9170a6aa929f7ec" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42327 } } peers { permanent_uuid: "63846d4150e64daa878f3d284762df90" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34291 } } peers { permanent_uuid: "02013e6561ae4015867cc01f798ce63a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 41631 } }
I20260924 12:58:00.445062 29649 raft_consensus.cc:348] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5590aa254bbb4187b9170a6aa929f7ec" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42327 } } peers { permanent_uuid: "63846d4150e64daa878f3d284762df90" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34291 } } peers { permanent_uuid: "02013e6561ae4015867cc01f798ce63a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 41631 } }
I20260924 12:58:00.445574 29649 raft_consensus.cc:374] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:00.445686 29649 raft_consensus.cc:729] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02013e6561ae4015867cc01f798ce63a, State: Initialized, Role: FOLLOWER
I20260924 12:58:00.446324 29649 consensus_queue.cc:260] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5590aa254bbb4187b9170a6aa929f7ec" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42327 } } peers { permanent_uuid: "63846d4150e64daa878f3d284762df90" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34291 } } peers { permanent_uuid: "02013e6561ae4015867cc01f798ce63a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 41631 } }
I20260924 12:58:00.446707 29652 leader_election.cc:288] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63846d4150e64daa878f3d284762df90 (127.11.49.66:34291), 02013e6561ae4015867cc01f798ce63a (127.11.49.65:41631)
I20260924 12:58:00.449416 29649 ts_tablet_manager.cc:1428] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a: Time spent starting tablet: real 0.017s user 0.015s sys 0.000s
I20260924 12:58:00.455641 29629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.447032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:34291 (local address 127.11.49.67:47053)
0924 12:58:00.447497 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:00.447521 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:00.447711 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:00.448822 (+ 1111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:00.448827 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:00.448857 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:00.449077 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.449090 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.450579 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.450584 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.453121 (+ 2537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.453138 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.454627 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.454634 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.454891 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.454927 (+ 36us) client_negotiation.cc:769] Sending connection context
0924 12:58:00.455049 (+ 122us) client_negotiation.cc:240] Negotiation successful
0924 12:58:00.455248 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":6}
I20260924 12:58:00.455721 29642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.447261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:47053 (local address 127.11.49.66:34291)
0924 12:58:00.447496 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:00.447502 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:00.447986 (+ 484us) server_negotiation.cc:407] Connection header received
0924 12:58:00.448073 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:00.448079 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:00.448176 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:00.448309 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:00.449289 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.450359 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.453333 (+ 2974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.454439 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.454626 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.454714 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:00.455144 (+ 430us) server_negotiation.cc:299] Negotiation successful
0924 12:58:00.455356 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260924 12:58:00.457171 29451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5b8b0e87734ddeb553906e5242d794" candidate_uuid: "5590aa254bbb4187b9170a6aa929f7ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63846d4150e64daa878f3d284762df90" is_pre_election: true
I20260924 12:58:00.457823 29451 raft_consensus.cc:2454] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5590aa254bbb4187b9170a6aa929f7ec in term 0.
I20260924 12:58:00.458096 29644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.448574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:52091 (local address 127.11.49.65:41631)
0924 12:58:00.448805 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:00.448816 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:00.451545 (+ 2729us) server_negotiation.cc:407] Connection header received
0924 12:58:00.451811 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:00.451817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:00.451923 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:00.451992 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:00.452829 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.453690 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.455625 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.456926 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.457105 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.457189 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:00.457701 (+ 512us) server_negotiation.cc:299] Negotiation successful
0924 12:58:00.457842 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260924 12:58:00.458243 29654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.447532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:41631 (local address 127.11.49.67:52091)
0924 12:58:00.451430 (+ 3898us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:00.451448 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:00.451617 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:00.452164 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:00.452167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:00.452187 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:00.452663 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.452674 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.453875 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.453880 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.455381 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:00.455397 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.457287 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.457295 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:00.457510 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.457554 (+ 44us) client_negotiation.cc:769] Sending connection context
0924 12:58:00.457665 (+ 111us) client_negotiation.cc:240] Negotiation successful
0924 12:58:00.457830 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3768,"mutex_wait_us":1,"thread_start_us":3355,"threads_started":1}
I20260924 12:58:00.458699 29517 leader_election.cc:302] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5590aa254bbb4187b9170a6aa929f7ec, 63846d4150e64daa878f3d284762df90; no voters:
I20260924 12:58:00.459214 29652 raft_consensus.cc:2781] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:58:00.459409 29652 raft_consensus.cc:482] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:58:00.459527 29652 raft_consensus.cc:3037] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:00.460122 29320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5b8b0e87734ddeb553906e5242d794" candidate_uuid: "5590aa254bbb4187b9170a6aa929f7ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02013e6561ae4015867cc01f798ce63a" is_pre_election: true
I20260924 12:58:00.460893 29320 raft_consensus.cc:2454] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5590aa254bbb4187b9170a6aa929f7ec in term 0.
I20260924 12:58:00.462700 29652 raft_consensus.cc:504] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5590aa254bbb4187b9170a6aa929f7ec" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42327 } } peers { permanent_uuid: "63846d4150e64daa878f3d284762df90" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34291 } } peers { permanent_uuid: "02013e6561ae4015867cc01f798ce63a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 41631 } }
I20260924 12:58:00.463358 29652 leader_election.cc:288] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [CANDIDATE]: Term 1 election: Requested vote from peers 63846d4150e64daa878f3d284762df90 (127.11.49.66:34291), 02013e6561ae4015867cc01f798ce63a (127.11.49.65:41631)
I20260924 12:58:00.463979 29451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5b8b0e87734ddeb553906e5242d794" candidate_uuid: "5590aa254bbb4187b9170a6aa929f7ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63846d4150e64daa878f3d284762df90"
I20260924 12:58:00.464262 29451 raft_consensus.cc:3037] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:00.464361 29320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5b8b0e87734ddeb553906e5242d794" candidate_uuid: "5590aa254bbb4187b9170a6aa929f7ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02013e6561ae4015867cc01f798ce63a"
I20260924 12:58:00.464639 29320 raft_consensus.cc:3037] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:00.468148 29451 raft_consensus.cc:2454] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5590aa254bbb4187b9170a6aa929f7ec in term 1.
I20260924 12:58:00.468148 29320 raft_consensus.cc:2454] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5590aa254bbb4187b9170a6aa929f7ec in term 1.
I20260924 12:58:00.468839 29517 leader_election.cc:302] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5590aa254bbb4187b9170a6aa929f7ec, 63846d4150e64daa878f3d284762df90; no voters:
I20260924 12:58:00.469257 29652 raft_consensus.cc:2781] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:00.469870 29652 raft_consensus.cc:686] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 1 LEADER]: Becoming Leader. State: Replica: 5590aa254bbb4187b9170a6aa929f7ec, State: Running, Role: LEADER
I20260924 12:58:00.470647 29652 consensus_queue.cc:237] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5590aa254bbb4187b9170a6aa929f7ec" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42327 } } peers { permanent_uuid: "63846d4150e64daa878f3d284762df90" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34291 } } peers { permanent_uuid: "02013e6561ae4015867cc01f798ce63a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 41631 } }
I20260924 12:58:00.477692 29178 catalog_manager.cc:5495] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 5590aa254bbb4187b9170a6aa929f7ec (127.11.49.67). New cstate: current_term: 1 leader_uuid: "5590aa254bbb4187b9170a6aa929f7ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5590aa254bbb4187b9170a6aa929f7ec" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 42327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63846d4150e64daa878f3d284762df90" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02013e6561ae4015867cc01f798ce63a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260924 12:58:00.520047 29641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.513170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52842 (local address 127.11.49.67:42327)
0924 12:58:00.513414 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:00.513422 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:00.513448 (+ 26us) server_negotiation.cc:407] Connection header received
0924 12:58:00.513712 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:00.513717 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:00.513817 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:00.514014 (+ 197us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:58:00.514451 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.515324 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.517384 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.517848 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.518023 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.518679 (+ 656us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:58:00.519367 (+ 688us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:58:00.519551 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:00.519617 (+ 66us) server_negotiation.cc:299] Negotiation successful
0924 12:58:00.519719 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260924 12:58:00.531530 29320 raft_consensus.cc:1261] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a [term 1 FOLLOWER]: Refusing update from remote peer 5590aa254bbb4187b9170a6aa929f7ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:58:00.531530 29451 raft_consensus.cc:1261] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90 [term 1 FOLLOWER]: Refusing update from remote peer 5590aa254bbb4187b9170a6aa929f7ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:58:00.532883 29655 consensus_queue.cc:1035] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "63846d4150e64daa878f3d284762df90" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:58:00.533439 29652 consensus_queue.cc:1035] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "02013e6561ae4015867cc01f798ce63a" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260924 12:58:00.540741 29627 tablet.cc:2369] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:58:00.565054 29178 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:58:00.565495 29178 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:58:00.571234 29178 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1f5e06259c04a6193ef661fe40eed86: Sending DeleteTablet for 3 replicas of tablet 0f5b8b0e87734ddeb553906e5242d794
I20260924 12:58:00.572961 29561 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f5b8b0e87734ddeb553906e5242d794 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:00 UTC) from {username='slave'} at 127.0.0.1:52840
I20260924 12:58:00.573338 29431 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f5b8b0e87734ddeb553906e5242d794 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:00 UTC) from {username='slave'} at 127.0.0.1:40516
I20260924 12:58:00.574143 29300 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f5b8b0e87734ddeb553906e5242d794 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:00 UTC) from {username='slave'} at 127.0.0.1:51904
I20260924 12:58:00.574949 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 29238
I20260924 12:58:00.581063 29669 tablet_replica.cc:330] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a: stopping tablet replica
I20260924 12:58:00.581887 29669 raft_consensus.cc:2229] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:58:00.582733 29669 raft_consensus.cc:2258] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:00.583485 29668 tablet_replica.cc:330] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: stopping tablet replica
I20260924 12:58:00.586207 29669 ts_tablet_manager.cc:1905] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:00.586911 29668 raft_consensus.cc:2229] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:58:00.587598 29668 raft_consensus.cc:2258] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:00.590430 29668 ts_tablet_manager.cc:1905] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:00.597116 29667 tablet_replica.cc:330] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: stopping tablet replica
I20260924 12:58:00.597808 29667 raft_consensus.cc:2229] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:58:00.598387 29668 ts_tablet_manager.cc:1918] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:00.598603 29668 log.cc:1196] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/0f5b8b0e87734ddeb553906e5242d794
I20260924 12:58:00.598912 29667 raft_consensus.cc:2258] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:00.599206 29668 ts_tablet_manager.cc:1939] T 0f5b8b0e87734ddeb553906e5242d794 P 63846d4150e64daa878f3d284762df90: Deleting consensus metadata
I20260924 12:58:00.600756 29669 ts_tablet_manager.cc:1918] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:00.600986 29669 log.cc:1196] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/0f5b8b0e87734ddeb553906e5242d794
I20260924 12:58:00.601593 29644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.576669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51920 (local address 127.11.49.65:41631)
0924 12:58:00.576845 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:00.576853 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:00.579861 (+ 3008us) server_negotiation.cc:407] Connection header received
0924 12:58:00.580183 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:00.580190 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:00.580402 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:00.580552 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:00.583928 (+ 3376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.585135 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.587142 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.587799 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.587908 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.599020 (+ 11112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:00.599087 (+ 67us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:00.599112 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:00.600193 (+ 1081us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:00.600338 (+ 145us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:00.600377 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:00.600520 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:00.600872 (+ 352us) server_negotiation.cc:299] Negotiation successful
0924 12:58:00.601073 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260924 12:58:00.601675 29669 ts_tablet_manager.cc:1939] T 0f5b8b0e87734ddeb553906e5242d794 P 02013e6561ae4015867cc01f798ce63a: Deleting consensus metadata
I20260924 12:58:00.601719 29667 ts_tablet_manager.cc:1905] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:00.603142 29360 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:00.606238 29166 catalog_manager.cc:4841] TS 63846d4150e64daa878f3d284762df90 (127.11.49.66:34291): tablet 0f5b8b0e87734ddeb553906e5242d794 (table test-table [id=68f60f97c0604de49a4f1bbce626c311]) successfully deleted
I20260924 12:58:00.612989 29667 ts_tablet_manager.cc:1918] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:00.613327 29667 log.cc:1196] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/0f5b8b0e87734ddeb553906e5242d794
I20260924 12:58:00.614012 29667 ts_tablet_manager.cc:1939] T 0f5b8b0e87734ddeb553906e5242d794 P 5590aa254bbb4187b9170a6aa929f7ec: Deleting consensus metadata
I20260924 12:58:00.616533 29165 catalog_manager.cc:4841] TS 5590aa254bbb4187b9170a6aa929f7ec (127.11.49.67:42327): tablet 0f5b8b0e87734ddeb553906e5242d794 (table test-table [id=68f60f97c0604de49a4f1bbce626c311]) successfully deleted
I20260924 12:58:00.737924 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 29238
I20260924 12:58:00.740708 29166 catalog_manager.cc:4841] TS 02013e6561ae4015867cc01f798ce63a (127.11.49.65:41631): tablet 0f5b8b0e87734ddeb553906e5242d794 (table test-table [id=68f60f97c0604de49a4f1bbce626c311]) successfully deleted
I20260924 12:58:00.760039 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 29369
I20260924 12:58:00.768868 29642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.761194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40528 (local address 127.11.49.66:34291)
0924 12:58:00.761472 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:00.761479 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:00.761505 (+ 26us) server_negotiation.cc:407] Connection header received
0924 12:58:00.761596 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:00.761603 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:00.761738 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:00.761869 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:00.762349 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.763201 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.764985 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.765445 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.765613 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.767037 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:00.767049 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:00.767069 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:00.767851 (+ 782us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:00.767917 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:00.767940 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:00.768104 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:00.768252 (+ 148us) server_negotiation.cc:299] Negotiation successful
0924 12:58:00.768452 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260924 12:58:00.769855 29491 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:00.874073 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 29369
I20260924 12:58:00.899235 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 29499
I20260924 12:58:00.909623 29641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:00.900434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52856 (local address 127.11.49.67:42327)
0924 12:58:00.900652 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:00.900658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:00.900924 (+ 266us) server_negotiation.cc:407] Connection header received
0924 12:58:00.901124 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:00.901132 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:00.901296 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:00.901463 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:00.901966 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.903178 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.905167 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:00.905973 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:00.906140 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:00.907665 (+ 1525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:00.907680 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:00.907709 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:00.908633 (+ 924us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:00.908704 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:00.908735 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:00.908879 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:00.909079 (+ 200us) server_negotiation.cc:299] Negotiation successful
0924 12:58:00.909198 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260924 12:58:00.910741 29621 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:01.059111 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 29499
I20260924 12:58:01.083243 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 29148
I20260924 12:58:01.084594 29209 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:01.217623 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 29148
2026-09-24T12:58:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3302 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:01 dist-test-slave-m9hg krb5kdc[29677](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:01 dist-test-slave-m9hg krb5kdc[29677](info): set up 2 sockets
Sep 24 12:58:01 dist-test-slave-m9hg krb5kdc[29677](info): commencing operation
krb5kdc: starting...
W20260924 12:58:02.377038 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:02 dist-test-slave-m9hg krb5kdc[29677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:58:02.689654 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:37361
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:37361
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:03.057219 29690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:03.057538 29690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:03.057674 29690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:03.065373 29690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:03.065501 29690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:03.065550 29690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:03.065660 29690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:03.065734 29690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:03.076328 29690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:37361
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:37361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:03.077759 29690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:03.079092 29690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:03.093336 29695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:03.093439 29698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:03.093408 29696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:03.094403 29690 server_base.cc:1034] running on GCE node
I20260924 12:58:03.095398 29690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:03.097187 29690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:03.098472 29690 hybrid_clock.cc:648] HybridClock initialized: now 1790254683098414 us; error 60 us; skew 500 ppm
I20260924 12:58:03.098891 29690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:03 dist-test-slave-m9hg krb5kdc[29677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254683, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:03.102658 29690 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:58:03.104806 29690 webserver.cc:460] Webserver started at http://127.11.49.126:35329/ using document root <none> and password file <none>
I20260924 12:58:03.105544 29690 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:03.105702 29690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:03.106029 29690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:03.109243 29690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "ca3c8754ba1745949626d535cbe21605"
format_stamp: "Formatted at 2026-09-24 12:58:03 on dist-test-slave-m9hg"
server_key: "6487b61685bd77cdd1f13b068954e14b"
server_key_iv: "3aaf80bf9134d6af03864ebcbffcc66a"
server_key_version: "encryptionkey@0"
I20260924 12:58:03.110044 29690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "ca3c8754ba1745949626d535cbe21605"
format_stamp: "Formatted at 2026-09-24 12:58:03 on dist-test-slave-m9hg"
server_key: "6487b61685bd77cdd1f13b068954e14b"
server_key_iv: "3aaf80bf9134d6af03864ebcbffcc66a"
server_key_version: "encryptionkey@0"
I20260924 12:58:03.116223 29690 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260924 12:58:03.120982 29705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:03.122880 29690 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260924 12:58:03.123143 29690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "ca3c8754ba1745949626d535cbe21605"
format_stamp: "Formatted at 2026-09-24 12:58:03 on dist-test-slave-m9hg"
server_key: "6487b61685bd77cdd1f13b068954e14b"
server_key_iv: "3aaf80bf9134d6af03864ebcbffcc66a"
server_key_version: "encryptionkey@0"
I20260924 12:58:03.123423 29690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:03.139750 29690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:03.145761 29690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:03.146095 29690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:03.169836 29690 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:37361
I20260924 12:58:03.169899 29756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:37361 every 8 connection(s)
I20260924 12:58:03.171619 29690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:03.172999 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 29690
I20260924 12:58:03.173252 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:03.173781 11461 external_mini_cluster.cc:1428] Setting key 4ead9c3caf975de7fbdb112ca37ecb61
I20260924 12:58:03.178122 29757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 24 12:58:03 dist-test-slave-m9hg krb5kdc[29677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:58:03.194562 29757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605: Bootstrap starting.
I20260924 12:58:03.200037 29757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:03.201821 29757 log.cc:824] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:03.204487 29760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:03.176387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59850 (local address 127.11.49.126:37361)
0924 12:58:03.177422 (+ 1035us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:03.177457 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:03.177527 (+ 70us) server_negotiation.cc:407] Connection header received
0924 12:58:03.180147 (+ 2620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:03.180185 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:03.180882 (+ 697us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:03.181463 (+ 581us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:03.183048 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:03.185399 (+ 2351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:03.187067 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:03.188332 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:03.188604 (+ 272us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:03.193692 (+ 5088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:03.193706 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:03.193736 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:03.193809 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:03.198616 (+ 4807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:03.199643 (+ 1027us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:03.199654 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:03.199665 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:03.199954 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:03.200562 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:03.200572 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:03.200577 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:03.201493 (+ 916us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:03.201863 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:03.202295 (+ 432us) server_negotiation.cc:299] Negotiation successful
0924 12:58:03.202966 (+ 671us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":722,"thread_start_us":434,"threads_started":1}
I20260924 12:58:03.206051 29757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605: No bootstrap required, opened a new log
I20260924 12:58:03.215662 29757 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3c8754ba1745949626d535cbe21605" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37361 } }
I20260924 12:58:03.216248 29757 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:03.216435 29757 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca3c8754ba1745949626d535cbe21605, State: Initialized, Role: FOLLOWER
I20260924 12:58:03.217204 29757 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3c8754ba1745949626d535cbe21605" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37361 } }
I20260924 12:58:03.217516 29757 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:03.217681 29757 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:03.217907 29757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:03.221065 29757 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3c8754ba1745949626d535cbe21605" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37361 } }
I20260924 12:58:03.221807 29757 leader_election.cc:302] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca3c8754ba1745949626d535cbe21605; no voters:
I20260924 12:58:03.222594 29757 leader_election.cc:288] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:03.222837 29762 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:03.223906 29762 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [term 1 LEADER]: Becoming Leader. State: Replica: ca3c8754ba1745949626d535cbe21605, State: Running, Role: LEADER
I20260924 12:58:03.224654 29762 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3c8754ba1745949626d535cbe21605" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37361 } }
I20260924 12:58:03.225404 29757 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:03.229482 29763 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca3c8754ba1745949626d535cbe21605" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3c8754ba1745949626d535cbe21605" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37361 } } }
I20260924 12:58:03.230124 29763 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:03.231189 29764 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca3c8754ba1745949626d535cbe21605. Latest consensus state: current_term: 1 leader_uuid: "ca3c8754ba1745949626d535cbe21605" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3c8754ba1745949626d535cbe21605" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 37361 } } }
I20260924 12:58:03.231878 29764 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:03.231978 29770 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:03.238369 29770 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:03.250478 29770 catalog_manager.cc:1347] Generated new cluster ID: a90df83bfe4c4b9c9012bdbda31d9930
I20260924 12:58:03.250770 29770 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:03.265352 29770 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:03.267135 29770 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:03.276899 29770 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605: Generated new TSK 0
I20260924 12:58:03.278012 29770 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:58:03.361696 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37361
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:03.731810 29783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:03.732170 29783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:03.732372 29783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:03.740494 29783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:03.740664 29783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:03.740873 29783 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:58:03.751422 29783 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:03.752928 29783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:03.754279 29783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:03.770100 29791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:03.770255 29789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:03.770242 29788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:03.771176 29783 server_base.cc:1034] running on GCE node
I20260924 12:58:03.772058 29783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:03.773346 29783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:03.774672 29783 hybrid_clock.cc:648] HybridClock initialized: now 1790254683774616 us; error 67 us; skew 500 ppm
I20260924 12:58:03.775197 29783 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:03 dist-test-slave-m9hg krb5kdc[29677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254683, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:03.783411 29783 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:58:03.785475 29783 webserver.cc:460] Webserver started at http://127.11.49.65:38937/ using document root <none> and password file <none>
I20260924 12:58:03.786394 29783 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:03.786576 29783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:03.786972 29783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:03.790387 29783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "e83d45bd89424545bb01a6e408e9b9ad"
format_stamp: "Formatted at 2026-09-24 12:58:03 on dist-test-slave-m9hg"
server_key: "44459c82b5db88ebcb871a4c56760479"
server_key_iv: "9eb5f47e78ecfac8d910be894b359950"
server_key_version: "encryptionkey@0"
I20260924 12:58:03.791297 29783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "e83d45bd89424545bb01a6e408e9b9ad"
format_stamp: "Formatted at 2026-09-24 12:58:03 on dist-test-slave-m9hg"
server_key: "44459c82b5db88ebcb871a4c56760479"
server_key_iv: "9eb5f47e78ecfac8d910be894b359950"
server_key_version: "encryptionkey@0"
I20260924 12:58:03.798017 29783 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260924 12:58:03.802479 29798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:03.804352 29783 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260924 12:58:03.804586 29783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "e83d45bd89424545bb01a6e408e9b9ad"
format_stamp: "Formatted at 2026-09-24 12:58:03 on dist-test-slave-m9hg"
server_key: "44459c82b5db88ebcb871a4c56760479"
server_key_iv: "9eb5f47e78ecfac8d910be894b359950"
server_key_version: "encryptionkey@0"
I20260924 12:58:03.804867 29783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:03.840868 29783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:03.845553 29783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:03.845884 29783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:03.847064 29783 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:03.848747 29783 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:03.848865 29783 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:03.849041 29783 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:03.849117 29783 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:03.890107 29783 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:45937
I20260924 12:58:03.890240 29910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:45937 every 8 connection(s)
I20260924 12:58:03.891548 29783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:58:03.898926 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 29783
I20260924 12:58:03.899201 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:58:03.899785 11461 external_mini_cluster.cc:1428] Setting key 6e6fb6a89ff1a2c1e1ad30667c5c2e53
Sep 24 12:58:03 dist-test-slave-m9hg krb5kdc[29677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254683, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:58:03.917439 29913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:03.895237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:43435 (local address 127.11.49.126:37361)
0924 12:58:03.895883 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:03.895891 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:03.897095 (+ 1204us) server_negotiation.cc:407] Connection header received
0924 12:58:03.899193 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:03.899199 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:03.899323 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:03.899440 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:03.901339 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:03.902278 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:03.903856 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:03.904244 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:03.904454 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:03.908601 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:03.908613 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:03.908623 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:03.908692 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:03.913064 (+ 4372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:03.914142 (+ 1078us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:03.914149 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:03.914155 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:03.914369 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:03.915045 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:03.915050 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:03.915054 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:03.915456 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:03.915606 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:03.916817 (+ 1211us) server_negotiation.cc:299] Negotiation successful
0924 12:58:03.917117 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":321,"threads_started":1}
I20260924 12:58:03.919006 29914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:03.895955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:37361 (local address 127.11.49.65:43435)
0924 12:58:03.896896 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:03.896953 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:03.898884 (+ 1931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:03.899722 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:03.899731 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:03.900432 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:03.901154 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:03.901180 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:03.902437 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:03.902441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:03.903702 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:03.903714 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:03.904543 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:03.904551 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:03.904786 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:03.905495 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:58:03.905523 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:03.908199 (+ 2676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:03.913321 (+ 5122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:03.913329 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:03.913344 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:03.913936 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:03.914542 (+ 606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:03.914547 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:03.914550 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:03.914851 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:03.915615 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:03.915627 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:03.916245 (+ 618us) client_negotiation.cc:769] Sending connection context
0924 12:58:03.916648 (+ 403us) client_negotiation.cc:240] Negotiation successful
0924 12:58:03.917341 (+ 693us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":412,"threads_started":1}
I20260924 12:58:03.921279 29911 heartbeater.cc:347] Connected to a master server at 127.11.49.126:37361
I20260924 12:58:03.921767 29911 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:03.922789 29911 heartbeater.cc:511] Master 127.11.49.126:37361 requested a full tablet report, sending...
I20260924 12:58:03.925707 29722 ts_manager.cc:194] Registered new tserver with Master: e83d45bd89424545bb01a6e408e9b9ad (127.11.49.65:45937)
I20260924 12:58:03.927657 29722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:43435
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:58:03.972924 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37361
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:04.328359 29917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:04.328903 29917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:04.329109 29917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:04.338516 29917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:04.338769 29917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:04.339000 29917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:58:04.351342 29917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:04.353228 29917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:04.355280 29917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:04.374190 29923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:04.374172 29922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:04.374259 29925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:04.374783 29917 server_base.cc:1034] running on GCE node
I20260924 12:58:04.375941 29917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:04.377164 29917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:04.378475 29917 hybrid_clock.cc:648] HybridClock initialized: now 1790254684378400 us; error 66 us; skew 500 ppm
I20260924 12:58:04.378880 29917 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:04 dist-test-slave-m9hg krb5kdc[29677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254684, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:04.382484 29917 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:58:04.384559 29917 webserver.cc:460] Webserver started at http://127.11.49.66:36681/ using document root <none> and password file <none>
I20260924 12:58:04.385290 29917 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:04.385418 29917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:04.385690 29917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:04.388880 29917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef"
format_stamp: "Formatted at 2026-09-24 12:58:04 on dist-test-slave-m9hg"
server_key: "b723c60faf7548ad46cda5263c94d205"
server_key_iv: "4b183ad4f0730639db20b2ce71b6bcb9"
server_key_version: "encryptionkey@0"
I20260924 12:58:04.389654 29917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef"
format_stamp: "Formatted at 2026-09-24 12:58:04 on dist-test-slave-m9hg"
server_key: "b723c60faf7548ad46cda5263c94d205"
server_key_iv: "4b183ad4f0730639db20b2ce71b6bcb9"
server_key_version: "encryptionkey@0"
I20260924 12:58:04.395644 29917 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260924 12:58:04.399948 29932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:04.401788 29917 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:58:04.401988 29917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef"
format_stamp: "Formatted at 2026-09-24 12:58:04 on dist-test-slave-m9hg"
server_key: "b723c60faf7548ad46cda5263c94d205"
server_key_iv: "4b183ad4f0730639db20b2ce71b6bcb9"
server_key_version: "encryptionkey@0"
I20260924 12:58:04.402292 29917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:04.431671 29917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:04.436529 29917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:04.436791 29917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:04.437930 29917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:04.439394 29917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:04.439479 29917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:04.439566 29917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:04.439615 29917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:04.481418 29917 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:43267
I20260924 12:58:04.481536 30044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:43267 every 8 connection(s)
I20260924 12:58:04.482988 29917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:58:04.486340 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 29917
I20260924 12:58:04.486598 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:58:04.487259 11461 external_mini_cluster.cc:1428] Setting key 9d09ec25855f62876ce78f0c16bef82f
Sep 24 12:58:04 dist-test-slave-m9hg krb5kdc[29677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254684, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:58:04.513528 30047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:04.486363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:60435 (local address 127.11.49.126:37361)
0924 12:58:04.489293 (+ 2930us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:04.489300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:04.489324 (+ 24us) server_negotiation.cc:407] Connection header received
0924 12:58:04.491897 (+ 2573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:04.491902 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:04.491986 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:04.492101 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:04.494703 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:04.495623 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:04.498787 (+ 3164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:04.499390 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:04.499566 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:04.505236 (+ 5670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:04.505243 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:04.505248 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:04.505298 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:04.508868 (+ 3570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:04.510394 (+ 1526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:04.510399 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:04.510401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:04.510583 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:04.511244 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:04.511248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:04.511250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:04.511607 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:04.511747 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:04.512997 (+ 1250us) server_negotiation.cc:299] Negotiation successful
0924 12:58:04.513212 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2796,"thread_start_us":2677,"threads_started":1}
I20260924 12:58:04.515597 30048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:04.487147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:37361 (local address 127.11.49.66:60435)
0924 12:58:04.488535 (+ 1388us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:04.488636 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:04.491490 (+ 2854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:04.492487 (+ 997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:04.492504 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:04.493424 (+ 920us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:04.494368 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:04.494401 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:04.495887 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:04.495896 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:04.498484 (+ 2588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:04.498517 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:04.499736 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:04.499746 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:04.500156 (+ 410us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:04.501178 (+ 1022us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:58:04.501218 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:04.504810 (+ 3592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:04.509130 (+ 4320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:04.509146 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:04.509173 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:04.510153 (+ 980us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:04.510744 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:04.510751 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:04.510758 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:04.511089 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:04.511770 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:04.511782 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:04.512454 (+ 672us) client_negotiation.cc:769] Sending connection context
0924 12:58:04.512838 (+ 384us) client_negotiation.cc:240] Negotiation successful
0924 12:58:04.513639 (+ 801us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":862,"thread_start_us":489,"threads_started":1}
I20260924 12:58:04.517526 30045 heartbeater.cc:347] Connected to a master server at 127.11.49.126:37361
I20260924 12:58:04.518194 30045 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:04.519493 30045 heartbeater.cc:511] Master 127.11.49.126:37361 requested a full tablet report, sending...
I20260924 12:58:04.521888 29722 ts_manager.cc:194] Registered new tserver with Master: bd4ffc68b4a3419b948cbe6cdcfb5aef (127.11.49.66:43267)
I20260924 12:58:04.522898 29722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:60435
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:58:04.565182 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37361
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:43041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:58:04.932065 29911 heartbeater.cc:503] Master 127.11.49.126:37361 was elected leader, sending a full tablet report...
W20260924 12:58:04.993474 30051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:04.993924 30051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:04.994120 30051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:05.002667 30051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:05.002895 30051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:05.003116 30051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:58:05.015290 30051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:43041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:37361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:05.017457 30051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:05.019304 30051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:05.037501 30056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:05.037608 30057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:05.037818 30059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:05.038707 30051 server_base.cc:1034] running on GCE node
I20260924 12:58:05.039496 30051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:05.040825 30051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:05.042094 30051 hybrid_clock.cc:648] HybridClock initialized: now 1790254685042044 us; error 46 us; skew 500 ppm
I20260924 12:58:05.042519 30051 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:05 dist-test-slave-m9hg krb5kdc[29677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254685, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:05.046757 30051 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:58:05.048959 30051 webserver.cc:460] Webserver started at http://127.11.49.67:39363/ using document root <none> and password file <none>
I20260924 12:58:05.049908 30051 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:05.050086 30051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:05.050515 30051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:05.054495 30051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "ad1dff8ddec949b5a3777ee7add087d9"
format_stamp: "Formatted at 2026-09-24 12:58:05 on dist-test-slave-m9hg"
server_key: "240ca7d2426e1611858b36c1e1adf990"
server_key_iv: "23e4b5fea7245888fbdb02322cf7e532"
server_key_version: "encryptionkey@0"
I20260924 12:58:05.055498 30051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "ad1dff8ddec949b5a3777ee7add087d9"
format_stamp: "Formatted at 2026-09-24 12:58:05 on dist-test-slave-m9hg"
server_key: "240ca7d2426e1611858b36c1e1adf990"
server_key_iv: "23e4b5fea7245888fbdb02322cf7e532"
server_key_version: "encryptionkey@0"
I20260924 12:58:05.062606 30051 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260924 12:58:05.067926 30066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:05.070158 30051 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260924 12:58:05.070487 30051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "ad1dff8ddec949b5a3777ee7add087d9"
format_stamp: "Formatted at 2026-09-24 12:58:05 on dist-test-slave-m9hg"
server_key: "240ca7d2426e1611858b36c1e1adf990"
server_key_iv: "23e4b5fea7245888fbdb02322cf7e532"
server_key_version: "encryptionkey@0"
I20260924 12:58:05.070784 30051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:05.092775 30051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:05.098452 30051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:05.098848 30051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:05.100142 30051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:05.101902 30051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:05.102027 30051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:05.102195 30051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:05.102269 30051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:05.145270 30051 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:32829
I20260924 12:58:05.145323 30178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:32829 every 8 connection(s)
I20260924 12:58:05.146982 30051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:58:05.149317 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 30051
I20260924 12:58:05.149551 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:58:05.150082 11461 external_mini_cluster.cc:1428] Setting key 0e268df868443c3bafa11cebcb87d3ba
Sep 24 12:58:05 dist-test-slave-m9hg krb5kdc[29677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254685, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:58:05.173283 30181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.150823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:56049 (local address 127.11.49.126:37361)
0924 12:58:05.151488 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:05.151495 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:05.152797 (+ 1302us) server_negotiation.cc:407] Connection header received
0924 12:58:05.155259 (+ 2462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:05.155264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:05.155380 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:05.155521 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:05.157560 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.158418 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.160229 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.160927 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.161083 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.165860 (+ 4777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:05.165865 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:05.165870 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:05.165915 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:05.169368 (+ 3453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:05.170533 (+ 1165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:05.170538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:05.170541 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:05.170697 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:05.171265 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:05.171270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:05.171272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:05.171638 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:05.171764 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:05.172703 (+ 939us) server_negotiation.cc:299] Negotiation successful
0924 12:58:05.172920 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":323,"threads_started":1}
I20260924 12:58:05.174690 30182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.151468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:37361 (local address 127.11.49.67:56049)
0924 12:58:05.152621 (+ 1153us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.152673 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:05.154874 (+ 2201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:05.155852 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:05.155863 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:05.156611 (+ 748us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:05.157357 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.157378 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.158578 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.158591 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.160046 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.160061 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.161216 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.161224 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.161503 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.162354 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:58:05.162386 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:05.165505 (+ 3119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:05.169568 (+ 4063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:05.169579 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:05.169601 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:05.170366 (+ 765us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:05.170810 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:05.170816 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:05.170820 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:05.171124 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:05.171767 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:05.171775 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:05.172256 (+ 481us) client_negotiation.cc:769] Sending connection context
0924 12:58:05.172602 (+ 346us) client_negotiation.cc:240] Negotiation successful
0924 12:58:05.173209 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":437,"threads_started":1}
I20260924 12:58:05.176678 30179 heartbeater.cc:347] Connected to a master server at 127.11.49.126:37361
I20260924 12:58:05.177178 30179 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:05.178395 30179 heartbeater.cc:511] Master 127.11.49.126:37361 requested a full tablet report, sending...
I20260924 12:58:05.180482 29721 ts_manager.cc:194] Registered new tserver with Master: ad1dff8ddec949b5a3777ee7add087d9 (127.11.49.67:32829)
I20260924 12:58:05.181456 29721 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:56049
I20260924 12:58:05.193771 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:58:05.215956 30181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.199302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59856 (local address 127.11.49.126:37361)
0924 12:58:05.199611 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:05.199618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:05.200142 (+ 524us) server_negotiation.cc:407] Connection header received
0924 12:58:05.200446 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:05.200450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:05.200546 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:05.200651 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:05.202598 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.203437 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.205292 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.205701 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.205819 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.209567 (+ 3748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:05.209572 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:05.209576 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:05.209614 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:05.212513 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:05.213593 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:05.213598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:05.213600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:05.213731 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:05.214236 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:05.214240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:05.214242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:05.214575 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:05.214787 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:05.215361 (+ 574us) server_negotiation.cc:299] Negotiation successful
0924 12:58:05.215547 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260924 12:58:05.221362 29721 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59856:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:58:05.229002 29721 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:58:05.271315 30197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.247053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51808 (local address 127.11.49.65:45937)
0924 12:58:05.260162 (+ 13109us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:05.260175 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:05.261008 (+ 833us) server_negotiation.cc:407] Connection header received
0924 12:58:05.261295 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:05.261306 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:05.261625 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:05.261864 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:05.263256 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.265022 (+ 1766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.267897 (+ 2875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.269650 (+ 1753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.269814 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.270133 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:05.270686 (+ 553us) server_negotiation.cc:299] Negotiation successful
0924 12:58:05.270947 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12896,"thread_start_us":12684,"threads_started":1}
I20260924 12:58:05.271361 30194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.245568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45937 (local address 127.0.0.1:51808)
0924 12:58:05.260813 (+ 15245us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.260844 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:05.261008 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:05.261941 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:05.261953 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:05.261975 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:05.263019 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.263038 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.265385 (+ 2347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.265391 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.267671 (+ 2280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.267687 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.269970 (+ 2283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.269982 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.270277 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.270383 (+ 106us) client_negotiation.cc:769] Sending connection context
0924 12:58:05.270567 (+ 184us) client_negotiation.cc:240] Negotiation successful
0924 12:58:05.270842 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15064,"mutex_wait_us":143,"thread_start_us":14861,"threads_started":1}
I20260924 12:58:05.271410 30195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.245482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44584 (local address 127.11.49.67:32829)
0924 12:58:05.257882 (+ 12400us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:05.257899 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:05.259776 (+ 1877us) server_negotiation.cc:407] Connection header received
0924 12:58:05.260851 (+ 1075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:05.260858 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:05.261193 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:05.261459 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:05.263031 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.265023 (+ 1992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.268113 (+ 3090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.269797 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.269958 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.270247 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:05.270787 (+ 540us) server_negotiation.cc:299] Negotiation successful
0924 12:58:05.271027 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12066,"thread_start_us":12420,"threads_started":1}
I20260924 12:58:05.272248 30192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.245068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:32829 (local address 127.0.0.1:44584)
0924 12:58:05.259564 (+ 14496us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.259603 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:05.260612 (+ 1009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:05.261794 (+ 1182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:05.261802 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:05.261848 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:05.262705 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.262730 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.265272 (+ 2542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.265278 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.267875 (+ 2597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.267896 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.270304 (+ 2408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.270309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.270506 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.270550 (+ 44us) client_negotiation.cc:769] Sending connection context
0924 12:58:05.270628 (+ 78us) client_negotiation.cc:240] Negotiation successful
0924 12:58:05.271772 (+ 1144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14231,"mutex_wait_us":1035,"spinlock_wait_cycles":1280,"thread_start_us":13402,"threads_started":1}
I20260924 12:58:05.273510 30196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.246503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37504 (local address 127.11.49.66:43267)
0924 12:58:05.260162 (+ 13659us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:05.260175 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:05.260211 (+ 36us) server_negotiation.cc:407] Connection header received
0924 12:58:05.260396 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:05.260409 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:05.261300 (+ 891us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:05.261476 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:05.265291 (+ 3815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.266998 (+ 1707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.270254 (+ 3256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.271753 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.271912 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.272127 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:05.272923 (+ 796us) server_negotiation.cc:299] Negotiation successful
0924 12:58:05.273167 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13429,"thread_start_us":13516,"threads_started":1}
I20260924 12:58:05.274456 30193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.245001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:43267 (local address 127.0.0.1:37504)
0924 12:58:05.259011 (+ 14010us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.259080 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:05.259385 (+ 305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:05.261794 (+ 2409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:05.261802 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:05.261855 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:05.263019 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.263038 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.267185 (+ 4147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.267192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.270004 (+ 2812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.270021 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.272351 (+ 2330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.272358 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.272538 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.272576 (+ 38us) client_negotiation.cc:769] Sending connection context
0924 12:58:05.272675 (+ 99us) client_negotiation.cc:240] Negotiation successful
0924 12:58:05.274045 (+ 1370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13661,"mutex_wait_us":88,"spinlock_wait_cycles":6400,"thread_start_us":14813,"threads_started":1}
I20260924 12:58:05.276592 29846 tablet_service.cc:1467] Processing CreateTablet for tablet f6a5478b61364cffab303bd613fc73d5 (DEFAULT_TABLE table=test-table [id=f54d646990bb40589f1abbe79e6e6c2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:05.277252 30114 tablet_service.cc:1467] Processing CreateTablet for tablet f6a5478b61364cffab303bd613fc73d5 (DEFAULT_TABLE table=test-table [id=f54d646990bb40589f1abbe79e6e6c2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:05.278317 29846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6a5478b61364cffab303bd613fc73d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:05.278950 30114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6a5478b61364cffab303bd613fc73d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:05.279059 29980 tablet_service.cc:1467] Processing CreateTablet for tablet f6a5478b61364cffab303bd613fc73d5 (DEFAULT_TABLE table=test-table [id=f54d646990bb40589f1abbe79e6e6c2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:05.280493 29980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6a5478b61364cffab303bd613fc73d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:05.293460 30198 tablet_bootstrap.cc:492] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: Bootstrap starting.
I20260924 12:58:05.296041 30199 tablet_bootstrap.cc:492] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: Bootstrap starting.
I20260924 12:58:05.298664 30200 tablet_bootstrap.cc:492] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: Bootstrap starting.
I20260924 12:58:05.300449 30198 tablet_bootstrap.cc:654] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:05.300477 30199 tablet_bootstrap.cc:654] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:05.302078 30200 tablet_bootstrap.cc:654] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:05.302183 30198 log.cc:824] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:05.302201 30199 log.cc:824] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:05.303416 30200 log.cc:824] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:05.306653 30199 tablet_bootstrap.cc:492] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: No bootstrap required, opened a new log
I20260924 12:58:05.306694 30198 tablet_bootstrap.cc:492] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: No bootstrap required, opened a new log
I20260924 12:58:05.307061 30199 ts_tablet_manager.cc:1397] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.007s
I20260924 12:58:05.307061 30198 ts_tablet_manager.cc:1397] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.006s
I20260924 12:58:05.307555 30200 tablet_bootstrap.cc:492] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: No bootstrap required, opened a new log
I20260924 12:58:05.307909 30200 ts_tablet_manager.cc:1397] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.002s
I20260924 12:58:05.316007 30200 raft_consensus.cc:348] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1dff8ddec949b5a3777ee7add087d9" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 32829 } } peers { permanent_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43267 } } peers { permanent_uuid: "e83d45bd89424545bb01a6e408e9b9ad" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45937 } }
I20260924 12:58:05.316849 30200 raft_consensus.cc:374] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:05.317047 30200 raft_consensus.cc:729] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd4ffc68b4a3419b948cbe6cdcfb5aef, State: Initialized, Role: FOLLOWER
I20260924 12:58:05.318239 30200 consensus_queue.cc:260] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1dff8ddec949b5a3777ee7add087d9" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 32829 } } peers { permanent_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43267 } } peers { permanent_uuid: "e83d45bd89424545bb01a6e408e9b9ad" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45937 } }
I20260924 12:58:05.319561 30045 heartbeater.cc:503] Master 127.11.49.126:37361 was elected leader, sending a full tablet report...
I20260924 12:58:05.319883 30198 raft_consensus.cc:348] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1dff8ddec949b5a3777ee7add087d9" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 32829 } } peers { permanent_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43267 } } peers { permanent_uuid: "e83d45bd89424545bb01a6e408e9b9ad" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45937 } }
I20260924 12:58:05.319885 30199 raft_consensus.cc:348] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1dff8ddec949b5a3777ee7add087d9" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 32829 } } peers { permanent_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43267 } } peers { permanent_uuid: "e83d45bd89424545bb01a6e408e9b9ad" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45937 } }
I20260924 12:58:05.320568 30199 raft_consensus.cc:374] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:05.320695 30198 raft_consensus.cc:374] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:05.320781 30200 ts_tablet_manager.cc:1428] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: Time spent starting tablet: real 0.013s user 0.010s sys 0.003s
I20260924 12:58:05.320761 30199 raft_consensus.cc:729] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83d45bd89424545bb01a6e408e9b9ad, State: Initialized, Role: FOLLOWER
I20260924 12:58:05.320853 30198 raft_consensus.cc:729] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1dff8ddec949b5a3777ee7add087d9, State: Initialized, Role: FOLLOWER
I20260924 12:58:05.321683 30199 consensus_queue.cc:260] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1dff8ddec949b5a3777ee7add087d9" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 32829 } } peers { permanent_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43267 } } peers { permanent_uuid: "e83d45bd89424545bb01a6e408e9b9ad" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45937 } }
I20260924 12:58:05.321683 30198 consensus_queue.cc:260] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1dff8ddec949b5a3777ee7add087d9" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 32829 } } peers { permanent_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43267 } } peers { permanent_uuid: "e83d45bd89424545bb01a6e408e9b9ad" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45937 } }
I20260924 12:58:05.323167 30179 heartbeater.cc:503] Master 127.11.49.126:37361 was elected leader, sending a full tablet report...
I20260924 12:58:05.324323 30198 ts_tablet_manager.cc:1428] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
I20260924 12:58:05.326215 30199 ts_tablet_manager.cc:1428] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: Time spent starting tablet: real 0.019s user 0.016s sys 0.001s
W20260924 12:58:05.394873 29912 tablet.cc:2369] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:58:05.399307 30180 tablet.cc:2369] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:58:05.462779 30204 raft_consensus.cc:482] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:58:05.463153 30204 raft_consensus.cc:504] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1dff8ddec949b5a3777ee7add087d9" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 32829 } } peers { permanent_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43267 } } peers { permanent_uuid: "e83d45bd89424545bb01a6e408e9b9ad" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45937 } }
I20260924 12:58:05.464950 30204 leader_election.cc:288] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad1dff8ddec949b5a3777ee7add087d9 (127.11.49.67:32829), e83d45bd89424545bb01a6e408e9b9ad (127.11.49.65:45937)
I20260924 12:58:05.475888 30197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.465643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:42013 (local address 127.11.49.65:45937)
0924 12:58:05.465843 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:05.465850 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:05.466907 (+ 1057us) server_negotiation.cc:407] Connection header received
0924 12:58:05.467019 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:05.467025 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:05.467130 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:05.467260 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:05.468238 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.469541 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.472707 (+ 3166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.474104 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.474344 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.474436 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:05.475300 (+ 864us) server_negotiation.cc:299] Negotiation successful
0924 12:58:05.475491 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260924 12:58:05.475891 30195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.465554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:59325 (local address 127.11.49.67:32829)
0924 12:58:05.465801 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:05.465807 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:05.466782 (+ 975us) server_negotiation.cc:407] Connection header received
0924 12:58:05.467019 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:05.467025 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:05.467130 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:05.467260 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:05.468238 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.469538 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.472697 (+ 3159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.474148 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.474344 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.474436 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:05.475300 (+ 864us) server_negotiation.cc:299] Negotiation successful
0924 12:58:05.475476 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260924 12:58:05.476034 30207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.465460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:32829 (local address 127.11.49.66:59325)
0924 12:58:05.466573 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.466596 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:05.466784 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:05.467309 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:05.467314 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:05.467358 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:05.468018 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.468033 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.469726 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.469731 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.472414 (+ 2683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.472435 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.474505 (+ 2070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.474513 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.474858 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.475069 (+ 211us) client_negotiation.cc:769] Sending connection context
0924 12:58:05.475195 (+ 126us) client_negotiation.cc:240] Negotiation successful
0924 12:58:05.475386 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":927,"mutex_wait_us":341,"spinlock_wait_cycles":7168,"thread_start_us":607,"threads_started":1}
I20260924 12:58:05.476059 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.465492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45937 (local address 127.11.49.66:42013)
0924 12:58:05.466573 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.466596 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:05.466837 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:05.467309 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:05.467314 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:05.467352 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:05.468025 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.468033 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.469726 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.469731 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.472414 (+ 2683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:05.472435 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.474505 (+ 2070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.474513 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:05.474857 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.475069 (+ 212us) client_negotiation.cc:769] Sending connection context
0924 12:58:05.475195 (+ 126us) client_negotiation.cc:240] Negotiation successful
0924 12:58:05.475386 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":973,"mutex_wait_us":395,"spinlock_wait_cycles":37120,"thread_start_us":584,"threads_started":1}
I20260924 12:58:05.477931 30134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6a5478b61364cffab303bd613fc73d5" candidate_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1dff8ddec949b5a3777ee7add087d9" is_pre_election: true
I20260924 12:58:05.477931 29866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6a5478b61364cffab303bd613fc73d5" candidate_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83d45bd89424545bb01a6e408e9b9ad" is_pre_election: true
I20260924 12:58:05.478721 29866 raft_consensus.cc:2454] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd4ffc68b4a3419b948cbe6cdcfb5aef in term 0.
I20260924 12:58:05.478726 30134 raft_consensus.cc:2454] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd4ffc68b4a3419b948cbe6cdcfb5aef in term 0.
I20260924 12:58:05.479748 29935 leader_election.cc:302] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd4ffc68b4a3419b948cbe6cdcfb5aef, e83d45bd89424545bb01a6e408e9b9ad; no voters:
I20260924 12:58:05.480335 30204 raft_consensus.cc:2781] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:58:05.480644 30204 raft_consensus.cc:482] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:58:05.480844 30204 raft_consensus.cc:3037] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:05.483731 30204 raft_consensus.cc:504] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1dff8ddec949b5a3777ee7add087d9" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 32829 } } peers { permanent_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43267 } } peers { permanent_uuid: "e83d45bd89424545bb01a6e408e9b9ad" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45937 } }
I20260924 12:58:05.484614 30204 leader_election.cc:288] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [CANDIDATE]: Term 1 election: Requested vote from peers ad1dff8ddec949b5a3777ee7add087d9 (127.11.49.67:32829), e83d45bd89424545bb01a6e408e9b9ad (127.11.49.65:45937)
I20260924 12:58:05.485379 29866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6a5478b61364cffab303bd613fc73d5" candidate_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83d45bd89424545bb01a6e408e9b9ad"
I20260924 12:58:05.485450 30134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6a5478b61364cffab303bd613fc73d5" candidate_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1dff8ddec949b5a3777ee7add087d9"
W20260924 12:58:05.485626 30046 tablet.cc:2369] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:58:05.485687 30134 raft_consensus.cc:3037] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:05.485666 29866 raft_consensus.cc:3037] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:05.489466 30134 raft_consensus.cc:2454] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd4ffc68b4a3419b948cbe6cdcfb5aef in term 1.
I20260924 12:58:05.489459 29866 raft_consensus.cc:2454] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd4ffc68b4a3419b948cbe6cdcfb5aef in term 1.
I20260924 12:58:05.490094 29935 leader_election.cc:302] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd4ffc68b4a3419b948cbe6cdcfb5aef, e83d45bd89424545bb01a6e408e9b9ad; no voters:
I20260924 12:58:05.490475 30204 raft_consensus.cc:2781] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:05.491056 30204 raft_consensus.cc:686] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 1 LEADER]: Becoming Leader. State: Replica: bd4ffc68b4a3419b948cbe6cdcfb5aef, State: Running, Role: LEADER
I20260924 12:58:05.491712 30204 consensus_queue.cc:237] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1dff8ddec949b5a3777ee7add087d9" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 32829 } } peers { permanent_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43267 } } peers { permanent_uuid: "e83d45bd89424545bb01a6e408e9b9ad" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45937 } }
I20260924 12:58:05.497290 29720 catalog_manager.cc:5495] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef reported cstate change: term changed from 0 to 1, leader changed from <none> to bd4ffc68b4a3419b948cbe6cdcfb5aef (127.11.49.66). New cstate: current_term: 1 leader_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1dff8ddec949b5a3777ee7add087d9" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd4ffc68b4a3419b948cbe6cdcfb5aef" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 43267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83d45bd89424545bb01a6e408e9b9ad" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45937 } health_report { overall_health: UNKNOWN } } }
I20260924 12:58:05.524501 30196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.517856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37514 (local address 127.11.49.66:43267)
0924 12:58:05.518239 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:05.518248 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:05.518271 (+ 23us) server_negotiation.cc:407] Connection header received
0924 12:58:05.518394 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:05.518398 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:05.518509 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:05.518698 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:58:05.519185 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.519998 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.521685 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.522162 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.522312 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.523054 (+ 742us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:58:05.523724 (+ 670us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:58:05.523933 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:05.524080 (+ 147us) server_negotiation.cc:299] Negotiation successful
0924 12:58:05.524138 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190}
I20260924 12:58:05.535178 29866 raft_consensus.cc:1261] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad [term 1 FOLLOWER]: Refusing update from remote peer bd4ffc68b4a3419b948cbe6cdcfb5aef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:58:05.535414 30134 raft_consensus.cc:1261] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9 [term 1 FOLLOWER]: Refusing update from remote peer bd4ffc68b4a3419b948cbe6cdcfb5aef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:58:05.536806 30209 consensus_queue.cc:1035] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83d45bd89424545bb01a6e408e9b9ad" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 45937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:58:05.537377 30204 consensus_queue.cc:1035] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad1dff8ddec949b5a3777ee7add087d9" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:58:05.556670 30213 mvcc.cc:205] Tried to move back new op lower bound from 7332883191939420160 to 7332883191779078144. Current Snapshot: MvccSnapshot[applied={T|T < 7332883191939420160}]
I20260924 12:58:05.575532 29720 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:58:05.575938 29720 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:58:05.581136 29720 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ca3c8754ba1745949626d535cbe21605: Sending DeleteTablet for 3 replicas of tablet f6a5478b61364cffab303bd613fc73d5
I20260924 12:58:05.582958 30114 tablet_service.cc:1514] Processing DeleteTablet for tablet f6a5478b61364cffab303bd613fc73d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:05 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:44584
I20260924 12:58:05.583681 29846 tablet_service.cc:1514] Processing DeleteTablet for tablet f6a5478b61364cffab303bd613fc73d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:05 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:51808
I20260924 12:58:05.591524 29980 tablet_service.cc:1514] Processing DeleteTablet for tablet f6a5478b61364cffab303bd613fc73d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:05 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:37504
I20260924 12:58:05.594533 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 29783
I20260924 12:58:05.600071 30222 tablet_replica.cc:330] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: stopping tablet replica
I20260924 12:58:05.601071 30222 raft_consensus.cc:2229] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:58:05.601951 30222 raft_consensus.cc:2258] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:05.604681 30224 tablet_replica.cc:330] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: stopping tablet replica
I20260924 12:58:05.605473 30224 raft_consensus.cc:2229] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:58:05.606276 30222 ts_tablet_manager.cc:1905] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:05.606506 30224 raft_consensus.cc:2258] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:05.609391 30224 ts_tablet_manager.cc:1905] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:05.615985 30222 ts_tablet_manager.cc:1918] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:05.616263 30222 log.cc:1196] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/f6a5478b61364cffab303bd613fc73d5
I20260924 12:58:05.617074 30222 ts_tablet_manager.cc:1939] T f6a5478b61364cffab303bd613fc73d5 P ad1dff8ddec949b5a3777ee7add087d9: Deleting consensus metadata
I20260924 12:58:05.618542 30224 ts_tablet_manager.cc:1918] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:05.618858 30224 log.cc:1196] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/f6a5478b61364cffab303bd613fc73d5
I20260924 12:58:05.619577 30224 ts_tablet_manager.cc:1939] T f6a5478b61364cffab303bd613fc73d5 P bd4ffc68b4a3419b948cbe6cdcfb5aef: Deleting consensus metadata
I20260924 12:58:05.620038 29706 catalog_manager.cc:4841] TS ad1dff8ddec949b5a3777ee7add087d9 (127.11.49.67:32829): tablet f6a5478b61364cffab303bd613fc73d5 (table test-table [id=f54d646990bb40589f1abbe79e6e6c2f]) successfully deleted
I20260924 12:58:05.621387 30223 tablet_replica.cc:330] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: stopping tablet replica
Sep 24 12:58:05 dist-test-slave-m9hg krb5kdc[29677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:58:05.622056 30223 raft_consensus.cc:2229] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:58:05.622135 29707 catalog_manager.cc:4841] TS bd4ffc68b4a3419b948cbe6cdcfb5aef (127.11.49.66:43267): tablet f6a5478b61364cffab303bd613fc73d5 (table test-table [id=f54d646990bb40589f1abbe79e6e6c2f]) successfully deleted
I20260924 12:58:05.622778 30223 raft_consensus.cc:2258] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:05.625847 30223 ts_tablet_manager.cc:1905] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:05.634318 30197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.596355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51822 (local address 127.11.49.65:45937)
0924 12:58:05.596666 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:05.596677 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:05.603393 (+ 6716us) server_negotiation.cc:407] Connection header received
0924 12:58:05.603524 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:05.603533 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:05.603708 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:05.603835 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:05.608208 (+ 4373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.609508 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.613805 (+ 4297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.614585 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.614720 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.624061 (+ 9341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:05.624090 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:05.624132 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:05.624210 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:05.629514 (+ 5304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:05.630908 (+ 1394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:05.630922 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:05.630929 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:05.631186 (+ 257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:05.631805 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:05.631811 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:05.631815 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:05.632496 (+ 681us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:05.632966 (+ 470us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:05.633384 (+ 418us) server_negotiation.cc:299] Negotiation successful
0924 12:58:05.633723 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260924 12:58:05.634692 30223 ts_tablet_manager.cc:1918] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:05.634970 30223 log.cc:1196] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/f6a5478b61364cffab303bd613fc73d5
I20260924 12:58:05.635272 29906 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:05.741942 30223 ts_tablet_manager.cc:1939] T f6a5478b61364cffab303bd613fc73d5 P e83d45bd89424545bb01a6e408e9b9ad: Deleting consensus metadata
I20260924 12:58:05.742739 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 29783
W20260924 12:58:05.762775 29708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.49.65:45937 (error 108)
I20260924 12:58:05.763515 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 29917
I20260924 12:58:05.765311 30193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.764635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45937 (local address 127.0.0.1:51836)
0924 12:58:05.764945 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.765073 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
W20260924 12:58:05.765720 29708 catalog_manager.cc:4584] TS e83d45bd89424545bb01a6e408e9b9ad (127.11.49.65:45937): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f6a5478b61364cffab303bd613fc73d5: Network error: Client connection negotiation failed: client connection to 127.11.49.65:45937: connect: Connection refused (error 111)
Sep 24 12:58:05 dist-test-slave-m9hg krb5kdc[29677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:58:05.786295 30196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.764701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37530 (local address 127.11.49.66:43267)
0924 12:58:05.764929 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:05.764936 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:05.764963 (+ 27us) server_negotiation.cc:407] Connection header received
0924 12:58:05.765071 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:05.765078 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:05.765205 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:05.765361 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:05.767167 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.768169 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.770371 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.770916 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.771117 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.777848 (+ 6731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:05.777875 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:05.777897 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:05.777954 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:05.782108 (+ 4154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:05.783207 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:05.783218 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:05.783221 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:05.783586 (+ 365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:05.784200 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:05.784205 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:05.784208 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:05.784798 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:05.785228 (+ 430us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:05.785549 (+ 321us) server_negotiation.cc:299] Negotiation successful
0924 12:58:05.785846 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260924 12:58:05.787285 30040 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:05.819929 30193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.819269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45937 (local address 127.0.0.1:51848)
0924 12:58:05.819605 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.819759 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
I20260924 12:58:05.821406 30193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.821003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45937 (local address 127.0.0.1:51856)
0924 12:58:05.821161 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.821257 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260924 12:58:05.882107 30193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.881631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45937 (local address 127.0.0.1:51866)
0924 12:58:05.881847 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.881932 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260924 12:58:05.883204 30193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.882842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45937 (local address 127.0.0.1:51872)
0924 12:58:05.883029 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.883104 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260924 12:58:05.926936 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 29917
I20260924 12:58:05.947444 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 30051
Sep 24 12:58:05 dist-test-slave-m9hg krb5kdc[29677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:58:05.964672 30193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.963663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45937 (local address 127.0.0.1:51876)
0924 12:58:05.964115 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.964276 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157}
I20260924 12:58:05.966276 30193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.965682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45937 (local address 127.0.0.1:51878)
0924 12:58:05.965953 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:05.966051 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260924 12:58:05.967896 30195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:05.948484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44600 (local address 127.11.49.67:32829)
0924 12:58:05.948671 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:05.948675 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:05.948780 (+ 105us) server_negotiation.cc:407] Connection header received
0924 12:58:05.948982 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:05.948986 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:05.949069 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:05.949187 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:05.950849 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.951613 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.953278 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:05.953692 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:05.953803 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:05.959983 (+ 6180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:05.960002 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:05.960018 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:05.960072 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:05.963821 (+ 3749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:05.965385 (+ 1564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:05.965393 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:05.965395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:05.965572 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:05.966160 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:05.966164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:05.966167 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:05.966661 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:05.966903 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:05.967375 (+ 472us) server_negotiation.cc:299] Negotiation successful
0924 12:58:05.967584 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260924 12:58:05.968906 30174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:06.073768 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 30051
I20260924 12:58:06.094697 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 29690
I20260924 12:58:06.096179 29752 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:06.227255 30193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:06.226455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:45937 (local address 127.0.0.1:51884)
0924 12:58:06.226752 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:06.226926 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260924 12:58:06.227469 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 29690
2026-09-24T12:58:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5007 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-24T12:58:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:06Z Disabled control of system clock
I20260924 12:58:06.318909 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38765
--webserver_interface=127.11.49.126
--webserver_port=0
--builtin_ntp_servers=127.11.49.84:40913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:38765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 12:58:06.768362 30234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:06.768802 30234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:06.768903 30234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:06.777592 30234 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:06.777768 30234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:06.777810 30234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:06.777868 30234 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:06.777918 30234 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:06.788967 30234 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:40913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:38765
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:38765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:06.790740 30234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:06.793123 30234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:06.810035 30239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:06.809968 30240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:06.809934 30242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:06.811555 30234 server_base.cc:1034] running on GCE node
I20260924 12:58:06.812695 30234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:06.814723 30234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:06.816152 30234 hybrid_clock.cc:648] HybridClock initialized: now 1790254686816064 us; error 89 us; skew 500 ppm
I20260924 12:58:06.816747 30234 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:58:06.819872 30234 webserver.cc:460] Webserver started at http://127.11.49.126:35659/ using document root <none> and password file <none>
I20260924 12:58:06.820863 30234 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:06.821022 30234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:06.821406 30234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:06.824931 30234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "bda845ba5b1e48fda89b8976cf7cd501"
format_stamp: "Formatted at 2026-09-24 12:58:06 on dist-test-slave-m9hg"
server_key: "3d607d24239a7ef113ee46172b781590"
server_key_iv: "7aa54c026fd6ef1dd2c99586ed4b5acc"
server_key_version: "encryptionkey@0"
I20260924 12:58:06.825853 30234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "bda845ba5b1e48fda89b8976cf7cd501"
format_stamp: "Formatted at 2026-09-24 12:58:06 on dist-test-slave-m9hg"
server_key: "3d607d24239a7ef113ee46172b781590"
server_key_iv: "7aa54c026fd6ef1dd2c99586ed4b5acc"
server_key_version: "encryptionkey@0"
I20260924 12:58:06.832626 30234 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260924 12:58:06.837656 30248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:06.839779 30234 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260924 12:58:06.840085 30234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "bda845ba5b1e48fda89b8976cf7cd501"
format_stamp: "Formatted at 2026-09-24 12:58:06 on dist-test-slave-m9hg"
server_key: "3d607d24239a7ef113ee46172b781590"
server_key_iv: "7aa54c026fd6ef1dd2c99586ed4b5acc"
server_key_version: "encryptionkey@0"
I20260924 12:58:06.840404 30234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:06.872805 30234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:06.873777 30234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:06.874114 30234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:06.897979 30234 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:38765
I20260924 12:58:06.898093 30299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:38765 every 8 connection(s)
I20260924 12:58:06.899614 30234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:06.902288 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 30234
I20260924 12:58:06.902508 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:06.903020 11461 external_mini_cluster.cc:1428] Setting key 174a570e09b054db39c46c3d01523fba
I20260924 12:58:06.906319 30300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:06.923744 30303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:06.905569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43810 (local address 127.11.49.126:38765)
0924 12:58:06.907066 (+ 1497us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:06.907087 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:06.907160 (+ 73us) server_negotiation.cc:407] Connection header received
0924 12:58:06.909893 (+ 2733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:06.909935 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:06.910855 (+ 920us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:06.911496 (+ 641us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:06.912258 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:06.914599 (+ 2341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:06.916591 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:06.917852 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:06.918150 (+ 298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:06.919728 (+ 1578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:06.919741 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:06.919769 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:06.920843 (+ 1074us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:06.920986 (+ 143us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:06.921026 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:06.921216 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:06.921523 (+ 307us) server_negotiation.cc:299] Negotiation successful
0924 12:58:06.922060 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":794,"thread_start_us":469,"threads_started":1}
I20260924 12:58:06.924690 30300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501: Bootstrap starting.
I20260924 12:58:06.929147 30300 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:06.930635 30300 log.cc:824] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:06.935009 30300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501: No bootstrap required, opened a new log
I20260924 12:58:06.944492 30300 raft_consensus.cc:348] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda845ba5b1e48fda89b8976cf7cd501" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38765 } }
I20260924 12:58:06.945196 30300 raft_consensus.cc:374] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:06.945343 30300 raft_consensus.cc:729] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda845ba5b1e48fda89b8976cf7cd501, State: Initialized, Role: FOLLOWER
I20260924 12:58:06.946223 30300 consensus_queue.cc:260] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda845ba5b1e48fda89b8976cf7cd501" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38765 } }
I20260924 12:58:06.946530 30300 raft_consensus.cc:388] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:06.946712 30300 raft_consensus.cc:482] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:06.946936 30300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:06.949757 30300 raft_consensus.cc:504] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda845ba5b1e48fda89b8976cf7cd501" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38765 } }
I20260924 12:58:06.950505 30300 leader_election.cc:302] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bda845ba5b1e48fda89b8976cf7cd501; no voters:
I20260924 12:58:06.951287 30300 leader_election.cc:288] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:06.951586 30305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:06.952771 30305 raft_consensus.cc:686] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [term 1 LEADER]: Becoming Leader. State: Replica: bda845ba5b1e48fda89b8976cf7cd501, State: Running, Role: LEADER
I20260924 12:58:06.953506 30305 consensus_queue.cc:237] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda845ba5b1e48fda89b8976cf7cd501" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38765 } }
I20260924 12:58:06.954308 30300 sys_catalog.cc:564] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:06.957131 30306 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bda845ba5b1e48fda89b8976cf7cd501" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda845ba5b1e48fda89b8976cf7cd501" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38765 } } }
I20260924 12:58:06.958029 30306 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:06.957532 30307 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bda845ba5b1e48fda89b8976cf7cd501. Latest consensus state: current_term: 1 leader_uuid: "bda845ba5b1e48fda89b8976cf7cd501" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda845ba5b1e48fda89b8976cf7cd501" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 38765 } } }
I20260924 12:58:06.958662 30307 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:06.960412 30314 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:06.966555 30314 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:06.977674 30314 catalog_manager.cc:1347] Generated new cluster ID: bfe466496e694366bb08371d83f54a0c
I20260924 12:58:06.977856 30314 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:06.993248 30314 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:06.995345 30314 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:07.010500 30314 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501: Generated new TSK 0
I20260924 12:58:07.012212 30314 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:07.027010 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38765
--builtin_ntp_servers=127.11.49.84:40913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 12:58:07.435647 30324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:07.436079 30324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:07.436254 30324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:07.446661 30324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:07.446827 30324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:07.447036 30324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:58:07.458781 30324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:40913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38765
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:07.460841 30324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:07.463308 30324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:07.480713 30332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:07.480808 30330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:07.480821 30329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:07.481956 30324 server_base.cc:1034] running on GCE node
I20260924 12:58:07.482817 30324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:07.484236 30324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:07.485565 30324 hybrid_clock.cc:648] HybridClock initialized: now 1790254687485515 us; error 40 us; skew 500 ppm
I20260924 12:58:07.486025 30324 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:58:07.489346 30324 webserver.cc:460] Webserver started at http://127.11.49.65:45927/ using document root <none> and password file <none>
I20260924 12:58:07.490332 30324 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:07.490496 30324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:07.490899 30324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:07.495162 30324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "86ed061e789746079d8333a59e291dbb"
format_stamp: "Formatted at 2026-09-24 12:58:07 on dist-test-slave-m9hg"
server_key: "2e154bba018a45d63b541e1f2d51e84b"
server_key_iv: "9fe05cd8c148421f905bb8f1661ca703"
server_key_version: "encryptionkey@0"
I20260924 12:58:07.496325 30324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "86ed061e789746079d8333a59e291dbb"
format_stamp: "Formatted at 2026-09-24 12:58:07 on dist-test-slave-m9hg"
server_key: "2e154bba018a45d63b541e1f2d51e84b"
server_key_iv: "9fe05cd8c148421f905bb8f1661ca703"
server_key_version: "encryptionkey@0"
I20260924 12:58:07.503713 30324 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.003s
I20260924 12:58:07.509151 30338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:07.511255 30324 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:58:07.511547 30324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "86ed061e789746079d8333a59e291dbb"
format_stamp: "Formatted at 2026-09-24 12:58:07 on dist-test-slave-m9hg"
server_key: "2e154bba018a45d63b541e1f2d51e84b"
server_key_iv: "9fe05cd8c148421f905bb8f1661ca703"
server_key_version: "encryptionkey@0"
I20260924 12:58:07.511884 30324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:07.535641 30324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:07.536960 30324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:07.537400 30324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:07.538947 30324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:07.541139 30324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:07.541306 30324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:07.541478 30324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:07.541584 30324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:07.587090 30324 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:40665
I20260924 12:58:07.587193 30450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:40665 every 8 connection(s)
I20260924 12:58:07.589460 30324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:58:07.595402 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 30324
I20260924 12:58:07.595656 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:58:07.596395 11461 external_mini_cluster.cc:1428] Setting key 043f61902ba06ffc117e3435077bc261
I20260924 12:58:07.600533 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38765
--builtin_ntp_servers=127.11.49.84:40913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260924 12:58:07.607954 30453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:07.593472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:37269 (local address 127.11.49.126:38765)
0924 12:58:07.594078 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:07.594085 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:07.595939 (+ 1854us) server_negotiation.cc:407] Connection header received
0924 12:58:07.599110 (+ 3171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:07.599118 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:07.599214 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:07.599377 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:07.601120 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:07.601910 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:07.604011 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:07.604599 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:07.604750 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:07.606727 (+ 1977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:07.606733 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:07.606737 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:07.606767 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:07.606831 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:07.606849 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:07.606979 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:07.607299 (+ 320us) server_negotiation.cc:299] Negotiation successful
0924 12:58:07.607462 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":314,"threads_started":1}
I20260924 12:58:07.609448 30454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:07.594055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38765 (local address 127.11.49.65:37269)
0924 12:58:07.595627 (+ 1572us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:07.595727 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:07.598489 (+ 2762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:07.599718 (+ 1229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:07.599732 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:07.599879 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:07.600869 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:07.600895 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:07.602118 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:07.602123 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:07.603821 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:07.603837 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:07.604896 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:07.604905 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:07.605203 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:07.606214 (+ 1011us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:58:07.606218 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:07.606279 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:58:07.606409 (+ 130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:07.606993 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:07.607010 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:07.607029 (+ 19us) client_negotiation.cc:769] Sending connection context
0924 12:58:07.607286 (+ 257us) client_negotiation.cc:240] Negotiation successful
0924 12:58:07.607884 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":400,"threads_started":1}
I20260924 12:58:07.611986 30451 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38765
I20260924 12:58:07.612547 30451 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:07.613756 30451 heartbeater.cc:511] Master 127.11.49.126:38765 requested a full tablet report, sending...
I20260924 12:58:07.617301 30265 ts_manager.cc:194] Registered new tserver with Master: 86ed061e789746079d8333a59e291dbb (127.11.49.65:40665)
I20260924 12:58:07.619256 30265 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.65:37269
W20260924 12:58:07.978063 30455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:07.978376 30455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:07.978515 30455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:07.986166 30455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:07.986296 30455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:07.986485 30455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:58:07.996074 30455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:40913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38765
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:07.997495 30455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:07.999341 30455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:08.014668 30460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:08.015096 30461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:08.015141 30463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:08.016744 30455 server_base.cc:1034] running on GCE node
I20260924 12:58:08.017791 30455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:08.019315 30455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:08.020606 30455 hybrid_clock.cc:648] HybridClock initialized: now 1790254688020531 us; error 63 us; skew 500 ppm
I20260924 12:58:08.021103 30455 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:58:08.024922 30455 webserver.cc:460] Webserver started at http://127.11.49.66:42147/ using document root <none> and password file <none>
I20260924 12:58:08.025955 30455 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:08.026073 30455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:08.026695 30455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:08.030810 30455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8"
format_stamp: "Formatted at 2026-09-24 12:58:08 on dist-test-slave-m9hg"
server_key: "17541b4dd8d0663da64de8bb5a7f5d04"
server_key_iv: "d2e47a855583bb3787e6f9a7c53f24aa"
server_key_version: "encryptionkey@0"
I20260924 12:58:08.031991 30455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8"
format_stamp: "Formatted at 2026-09-24 12:58:08 on dist-test-slave-m9hg"
server_key: "17541b4dd8d0663da64de8bb5a7f5d04"
server_key_iv: "d2e47a855583bb3787e6f9a7c53f24aa"
server_key_version: "encryptionkey@0"
I20260924 12:58:08.040007 30455 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260924 12:58:08.045588 30469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:08.047741 30455 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260924 12:58:08.048034 30455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8"
format_stamp: "Formatted at 2026-09-24 12:58:08 on dist-test-slave-m9hg"
server_key: "17541b4dd8d0663da64de8bb5a7f5d04"
server_key_iv: "d2e47a855583bb3787e6f9a7c53f24aa"
server_key_version: "encryptionkey@0"
I20260924 12:58:08.048486 30455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:08.075649 30455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:08.076906 30455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:08.077303 30455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:08.078640 30455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:08.080847 30455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:08.080971 30455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:08.081162 30455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:08.081238 30455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:08.123787 30455 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:45623
I20260924 12:58:08.123925 30581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:45623 every 8 connection(s)
I20260924 12:58:08.125980 30455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:58:08.126539 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 30455
I20260924 12:58:08.126798 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:58:08.127581 11461 external_mini_cluster.cc:1428] Setting key 3d7e3167f2fa4c178c67c2917055772e
I20260924 12:58:08.131707 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38765
--builtin_ntp_servers=127.11.49.84:40913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260924 12:58:08.156492 30584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.130355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:48903 (local address 127.11.49.126:38765)
0924 12:58:08.140864 (+ 10509us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:08.140875 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:08.142205 (+ 1330us) server_negotiation.cc:407] Connection header received
0924 12:58:08.145824 (+ 3619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:08.145834 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:08.145960 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:08.146107 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:08.148101 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.149002 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.152017 (+ 3015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.152831 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.152987 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.155361 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:08.155367 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:08.155371 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:08.155397 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:08.155458 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:08.155473 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:08.155568 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:08.155938 (+ 370us) server_negotiation.cc:299] Negotiation successful
0924 12:58:08.156041 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10197,"thread_start_us":10056,"threads_started":1}
I20260924 12:58:08.158352 30585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.131145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38765 (local address 127.11.49.66:48903)
0924 12:58:08.141955 (+ 10810us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:08.142020 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:08.145238 (+ 3218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:08.146496 (+ 1258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:08.146515 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:08.146687 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:08.147812 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.147845 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.149224 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.149233 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.151743 (+ 2510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.151772 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.153180 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.153191 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.153651 (+ 460us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.154819 (+ 1168us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:58:08.154825 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:08.154899 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:58:08.155100 (+ 201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:08.155609 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:08.155623 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:08.155637 (+ 14us) client_negotiation.cc:769] Sending connection context
0924 12:58:08.155914 (+ 277us) client_negotiation.cc:240] Negotiation successful
0924 12:58:08.156549 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9996,"thread_start_us":9501,"threads_started":1}
I20260924 12:58:08.160670 30582 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38765
I20260924 12:58:08.161173 30582 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:08.162081 30582 heartbeater.cc:511] Master 127.11.49.126:38765 requested a full tablet report, sending...
I20260924 12:58:08.163890 30265 ts_manager.cc:194] Registered new tserver with Master: dd529fdbfb5945fc8b37d8072a1cf6e8 (127.11.49.66:45623)
I20260924 12:58:08.164844 30265 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.66:48903
W20260924 12:58:08.557201 30586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:08.557600 30586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:08.557789 30586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:08.567003 30586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:08.567195 30586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:08.567421 30586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:58:08.578483 30586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:40913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:38765
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:08.580395 30586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:08.582850 30586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:08.600445 30591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:08.600438 30592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:08.600349 30594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:08.602315 30586 server_base.cc:1034] running on GCE node
I20260924 12:58:08.603274 30586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:08.604744 30586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:08.606091 30586 hybrid_clock.cc:648] HybridClock initialized: now 1790254688606026 us; error 52 us; skew 500 ppm
I20260924 12:58:08.606837 30586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:58:08.610819 30586 webserver.cc:460] Webserver started at http://127.11.49.67:41331/ using document root <none> and password file <none>
I20260924 12:58:08.611806 30586 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:08.611950 30586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:08.612350 30586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:08.615585 30586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "024f4554bf6047339a42e48ee66224ae"
format_stamp: "Formatted at 2026-09-24 12:58:08 on dist-test-slave-m9hg"
server_key: "d9b597753c18a5ea622c49f96febb69a"
server_key_iv: "d0efe58087397aa2185df52233fef14c"
server_key_version: "encryptionkey@0"
I20260924 12:58:08.616602 30586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "024f4554bf6047339a42e48ee66224ae"
format_stamp: "Formatted at 2026-09-24 12:58:08 on dist-test-slave-m9hg"
server_key: "d9b597753c18a5ea622c49f96febb69a"
server_key_iv: "d0efe58087397aa2185df52233fef14c"
server_key_version: "encryptionkey@0"
I20260924 12:58:08.623488 30586 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260924 12:58:08.624763 30451 heartbeater.cc:503] Master 127.11.49.126:38765 was elected leader, sending a full tablet report...
I20260924 12:58:08.628814 30600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:08.630887 30586 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260924 12:58:08.631135 30586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "024f4554bf6047339a42e48ee66224ae"
format_stamp: "Formatted at 2026-09-24 12:58:08 on dist-test-slave-m9hg"
server_key: "d9b597753c18a5ea622c49f96febb69a"
server_key_iv: "d0efe58087397aa2185df52233fef14c"
server_key_version: "encryptionkey@0"
I20260924 12:58:08.631405 30586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:08.650873 30586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:08.651803 30586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:08.652134 30586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:08.653517 30586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:08.655591 30586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:08.655755 30586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:08.655890 30586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:08.655989 30586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:08.698064 30586 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:41281
I20260924 12:58:08.698115 30712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:41281 every 8 connection(s)
I20260924 12:58:08.699667 30586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:58:08.702597 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 30586
I20260924 12:58:08.702873 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:58:08.703522 11461 external_mini_cluster.cc:1428] Setting key f39fbd5f16328fc0480663d345c19cb0
I20260924 12:58:08.717937 30715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.704090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:37667 (local address 127.11.49.126:38765)
0924 12:58:08.704929 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:08.704939 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:08.706609 (+ 1670us) server_negotiation.cc:407] Connection header received
0924 12:58:08.709535 (+ 2926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:08.709539 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:08.709629 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:08.709745 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:08.711364 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.712139 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.714185 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.714618 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.714731 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.716880 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:08.716885 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:08.716889 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:08.716913 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:08.716973 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:08.716987 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:08.717081 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:08.717419 (+ 338us) server_negotiation.cc:299] Negotiation successful
0924 12:58:08.717542 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":473,"threads_started":1}
I20260924 12:58:08.719930 30716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.704764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:38765 (local address 127.11.49.67:37667)
0924 12:58:08.706375 (+ 1611us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:08.706443 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:08.709074 (+ 2631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:08.710175 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:08.710187 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:08.710317 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:08.711147 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.711170 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.712420 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.712425 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.713994 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.714014 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.714922 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.714928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.715267 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.716357 (+ 1090us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:58:08.716362 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:08.716447 (+ 85us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:58:08.716597 (+ 150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:08.717133 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:08.717144 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:08.717152 (+ 8us) client_negotiation.cc:769] Sending connection context
0924 12:58:08.717376 (+ 224us) client_negotiation.cc:240] Negotiation successful
0924 12:58:08.718065 (+ 689us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":805,"thread_start_us":413,"threads_started":1}
I20260924 12:58:08.721796 30713 heartbeater.cc:347] Connected to a master server at 127.11.49.126:38765
I20260924 12:58:08.722218 30713 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:08.723225 30713 heartbeater.cc:511] Master 127.11.49.126:38765 requested a full tablet report, sending...
I20260924 12:58:08.725167 30265 ts_manager.cc:194] Registered new tserver with Master: 024f4554bf6047339a42e48ee66224ae (127.11.49.67:41281)
I20260924 12:58:08.726148 30265 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.67:37667
I20260924 12:58:08.735541 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:58:08.749379 30715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.740922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43814 (local address 127.11.49.126:38765)
0924 12:58:08.741335 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:08.741344 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:08.741680 (+ 336us) server_negotiation.cc:407] Connection header received
0924 12:58:08.741952 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:08.741965 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:08.742049 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:08.742180 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:08.742980 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.743854 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.745774 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.746395 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.746552 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.748157 (+ 1605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:08.748163 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:08.748167 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:08.748191 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:08.748230 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:08.748243 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:08.748474 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:08.748961 (+ 487us) server_negotiation.cc:299] Negotiation successful
0924 12:58:08.749038 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197}
I20260924 12:58:08.754521 30265 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43814:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:58:08.762069 30265 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:58:08.811764 30730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.777772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:45623 (local address 127.0.0.1:42902)
0924 12:58:08.800358 (+ 22586us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:08.800390 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:08.800581 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:08.803017 (+ 2436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:08.803025 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:08.803057 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:08.803570 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.803590 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.805477 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.805486 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.807920 (+ 2434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.807939 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.810502 (+ 2563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.810508 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.810756 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.810841 (+ 85us) client_negotiation.cc:769] Sending connection context
0924 12:58:08.811067 (+ 226us) client_negotiation.cc:240] Negotiation successful
0924 12:58:08.811341 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21738,"thread_start_us":24320,"threads_started":1}
I20260924 12:58:08.811786 30731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.778536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42902 (local address 127.11.49.66:45623)
0924 12:58:08.801885 (+ 23349us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:08.801893 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:08.801944 (+ 51us) server_negotiation.cc:407] Connection header received
0924 12:58:08.802082 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:08.802094 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:08.802417 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:08.802654 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:08.803822 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.805341 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.808319 (+ 2978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.810187 (+ 1868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.810391 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.810761 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:08.811119 (+ 358us) server_negotiation.cc:299] Negotiation successful
0924 12:58:08.811343 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23171,"thread_start_us":23065,"threads_started":1}
I20260924 12:58:08.812806 30726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.776952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:41281 (local address 127.0.0.1:38698)
0924 12:58:08.793346 (+ 16394us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:08.793406 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:08.793660 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:08.804025 (+ 10365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:08.804031 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:08.804065 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:08.804585 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.804602 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.806922 (+ 2320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.806928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.809638 (+ 2710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.809655 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.811919 (+ 2264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.811929 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.812136 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.812177 (+ 41us) client_negotiation.cc:769] Sending connection context
0924 12:58:08.812247 (+ 70us) client_negotiation.cc:240] Negotiation successful
0924 12:58:08.812450 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15994,"mutex_wait_us":1,"thread_start_us":16493,"threads_started":1}
I20260924 12:58:08.813513 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.777958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40665 (local address 127.0.0.1:58024)
0924 12:58:08.802434 (+ 24476us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:08.802455 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:08.802614 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:08.803374 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:08.803385 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:08.803432 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:08.803998 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.804013 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.806445 (+ 2432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.806451 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.810134 (+ 3683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.810168 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.812617 (+ 2449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.812625 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.812826 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.812864 (+ 38us) client_negotiation.cc:769] Sending connection context
0924 12:58:08.812970 (+ 106us) client_negotiation.cc:240] Negotiation successful
0924 12:58:08.813121 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24322,"mutex_wait_us":397,"thread_start_us":21342,"threads_started":1}
I20260924 12:58:08.814306 30727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.777478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38698 (local address 127.11.49.67:41281)
0924 12:58:08.803169 (+ 25691us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:08.803178 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:08.803218 (+ 40us) server_negotiation.cc:407] Connection header received
0924 12:58:08.803373 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:08.803382 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:08.803699 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:08.804862 (+ 1163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:08.805193 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.806734 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.809962 (+ 3228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.811632 (+ 1670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.813122 (+ 1490us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.813389 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:08.813529 (+ 140us) server_negotiation.cc:299] Negotiation successful
0924 12:58:08.813916 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25495,"thread_start_us":25285,"threads_started":1}
I20260924 12:58:08.814625 30729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.777972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58024 (local address 127.11.49.65:40665)
0924 12:58:08.801683 (+ 23711us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:08.801695 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:08.802757 (+ 1062us) server_negotiation.cc:407] Connection header received
0924 12:58:08.802867 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:08.802874 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:08.803111 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:08.803336 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:08.804261 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.806222 (+ 1961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.810449 (+ 4227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.811990 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.812136 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.812476 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:08.813872 (+ 1396us) server_negotiation.cc:299] Negotiation successful
0924 12:58:08.814133 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23463,"thread_start_us":23733,"threads_started":1}
I20260924 12:58:08.818387 30517 tablet_service.cc:1467] Processing CreateTablet for tablet 706cca7c808f4ae896c207c0f93a34d5 (DEFAULT_TABLE table=test-table [id=3c00fde349644002bd44c137484d152c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:08.818801 30648 tablet_service.cc:1467] Processing CreateTablet for tablet 706cca7c808f4ae896c207c0f93a34d5 (DEFAULT_TABLE table=test-table [id=3c00fde349644002bd44c137484d152c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:08.819228 30386 tablet_service.cc:1467] Processing CreateTablet for tablet 706cca7c808f4ae896c207c0f93a34d5 (DEFAULT_TABLE table=test-table [id=3c00fde349644002bd44c137484d152c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:08.820101 30648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 706cca7c808f4ae896c207c0f93a34d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:08.820101 30517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 706cca7c808f4ae896c207c0f93a34d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:08.820888 30386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 706cca7c808f4ae896c207c0f93a34d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:08.836234 30732 tablet_bootstrap.cc:492] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: Bootstrap starting.
I20260924 12:58:08.838888 30734 tablet_bootstrap.cc:492] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb: Bootstrap starting.
I20260924 12:58:08.841989 30733 tablet_bootstrap.cc:492] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: Bootstrap starting.
I20260924 12:58:08.843240 30734 tablet_bootstrap.cc:654] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:08.843376 30732 tablet_bootstrap.cc:654] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:08.844748 30734 log.cc:824] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:08.845206 30732 log.cc:824] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:08.846976 30733 tablet_bootstrap.cc:654] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:08.848899 30733 log.cc:824] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:08.849213 30732 tablet_bootstrap.cc:492] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: No bootstrap required, opened a new log
I20260924 12:58:08.849575 30732 ts_tablet_manager.cc:1397] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.000s
I20260924 12:58:08.849673 30734 tablet_bootstrap.cc:492] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb: No bootstrap required, opened a new log
I20260924 12:58:08.850203 30734 ts_tablet_manager.cc:1397] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.007s
I20260924 12:58:08.853732 30733 tablet_bootstrap.cc:492] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: No bootstrap required, opened a new log
I20260924 12:58:08.854291 30733 ts_tablet_manager.cc:1397] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260924 12:58:08.859381 30732 raft_consensus.cc:348] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024f4554bf6047339a42e48ee66224ae" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 41281 } } peers { permanent_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45623 } } peers { permanent_uuid: "86ed061e789746079d8333a59e291dbb" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40665 } }
I20260924 12:58:08.860113 30732 raft_consensus.cc:374] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:08.860262 30732 raft_consensus.cc:729] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd529fdbfb5945fc8b37d8072a1cf6e8, State: Initialized, Role: FOLLOWER
I20260924 12:58:08.861207 30732 consensus_queue.cc:260] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024f4554bf6047339a42e48ee66224ae" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 41281 } } peers { permanent_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45623 } } peers { permanent_uuid: "86ed061e789746079d8333a59e291dbb" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40665 } }
I20260924 12:58:08.862584 30582 heartbeater.cc:503] Master 127.11.49.126:38765 was elected leader, sending a full tablet report...
I20260924 12:58:08.863441 30732 ts_tablet_manager.cc:1428] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260924 12:58:08.863073 30734 raft_consensus.cc:348] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024f4554bf6047339a42e48ee66224ae" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 41281 } } peers { permanent_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45623 } } peers { permanent_uuid: "86ed061e789746079d8333a59e291dbb" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40665 } }
I20260924 12:58:08.863689 30734 raft_consensus.cc:374] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:08.863792 30734 raft_consensus.cc:729] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ed061e789746079d8333a59e291dbb, State: Initialized, Role: FOLLOWER
I20260924 12:58:08.865101 30734 consensus_queue.cc:260] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024f4554bf6047339a42e48ee66224ae" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 41281 } } peers { permanent_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45623 } } peers { permanent_uuid: "86ed061e789746079d8333a59e291dbb" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40665 } }
I20260924 12:58:08.868539 30733 raft_consensus.cc:348] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024f4554bf6047339a42e48ee66224ae" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 41281 } } peers { permanent_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45623 } } peers { permanent_uuid: "86ed061e789746079d8333a59e291dbb" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40665 } }
I20260924 12:58:08.869273 30733 raft_consensus.cc:374] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:08.869388 30733 raft_consensus.cc:729] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024f4554bf6047339a42e48ee66224ae, State: Initialized, Role: FOLLOWER
I20260924 12:58:08.870752 30733 consensus_queue.cc:260] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024f4554bf6047339a42e48ee66224ae" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 41281 } } peers { permanent_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45623 } } peers { permanent_uuid: "86ed061e789746079d8333a59e291dbb" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40665 } }
I20260924 12:58:08.871323 30734 ts_tablet_manager.cc:1428] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb: Time spent starting tablet: real 0.021s user 0.016s sys 0.004s
I20260924 12:58:08.872685 30713 heartbeater.cc:503] Master 127.11.49.126:38765 was elected leader, sending a full tablet report...
I20260924 12:58:08.873545 30733 ts_tablet_manager.cc:1428] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: Time spent starting tablet: real 0.019s user 0.015s sys 0.004s
W20260924 12:58:08.878996 30583 tablet.cc:2369] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:58:08.901053 30738 raft_consensus.cc:482] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:58:08.901541 30738 raft_consensus.cc:504] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024f4554bf6047339a42e48ee66224ae" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 41281 } } peers { permanent_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45623 } } peers { permanent_uuid: "86ed061e789746079d8333a59e291dbb" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40665 } }
I20260924 12:58:08.904701 30738 leader_election.cc:288] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 024f4554bf6047339a42e48ee66224ae (127.11.49.67:41281), 86ed061e789746079d8333a59e291dbb (127.11.49.65:40665)
I20260924 12:58:08.915550 30742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.905052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40665 (local address 127.11.49.66:53219)
0924 12:58:08.906889 (+ 1837us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:08.906906 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:08.907215 (+ 309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:08.907721 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:08.907725 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:08.907771 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:08.908241 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.908251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.910140 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.910146 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.912116 (+ 1970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.912141 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.914593 (+ 2452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.914601 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.914814 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.914910 (+ 96us) client_negotiation.cc:769] Sending connection context
0924 12:58:08.915051 (+ 141us) client_negotiation.cc:240] Negotiation successful
0924 12:58:08.915197 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1708,"mutex_wait_us":80,"thread_start_us":1063,"threads_started":1}
I20260924 12:58:08.916054 30727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.905823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:38707 (local address 127.11.49.67:41281)
0924 12:58:08.906075 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:08.906084 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:08.906721 (+ 637us) server_negotiation.cc:407] Connection header received
0924 12:58:08.907320 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:08.907327 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:08.907420 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:08.907523 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:08.908297 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.909667 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.913085 (+ 3418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.914457 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.914642 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.914722 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:08.915623 (+ 901us) server_negotiation.cc:299] Negotiation successful
0924 12:58:08.915865 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260924 12:58:08.916030 30729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.905517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:53219 (local address 127.11.49.65:40665)
0924 12:58:08.905786 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:08.905796 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:08.907041 (+ 1245us) server_negotiation.cc:407] Connection header received
0924 12:58:08.907425 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:08.907430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:08.907559 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:08.907659 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:08.908458 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.909667 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.912474 (+ 2807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.914222 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.914481 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.914601 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:08.915156 (+ 555us) server_negotiation.cc:299] Negotiation successful
0924 12:58:08.915556 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260924 12:58:08.916714 30741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.905034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:41281 (local address 127.11.49.66:38707)
0924 12:58:08.906544 (+ 1510us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:08.906573 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:08.906894 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:08.907572 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:08.907577 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:08.907610 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:08.908099 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.908114 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.909990 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.909995 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.912687 (+ 2692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:08.912711 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.914807 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.914813 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:08.915175 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.915400 (+ 225us) client_negotiation.cc:769] Sending connection context
0924 12:58:08.915538 (+ 138us) client_negotiation.cc:240] Negotiation successful
0924 12:58:08.916236 (+ 698us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1321,"mutex_wait_us":186,"thread_start_us":1508,"threads_started":1}
I20260924 12:58:08.917989 30406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "706cca7c808f4ae896c207c0f93a34d5" candidate_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ed061e789746079d8333a59e291dbb" is_pre_election: true
I20260924 12:58:08.918035 30668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "706cca7c808f4ae896c207c0f93a34d5" candidate_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024f4554bf6047339a42e48ee66224ae" is_pre_election: true
I20260924 12:58:08.918917 30668 raft_consensus.cc:2454] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd529fdbfb5945fc8b37d8072a1cf6e8 in term 0.
I20260924 12:58:08.918917 30406 raft_consensus.cc:2454] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd529fdbfb5945fc8b37d8072a1cf6e8 in term 0.
I20260924 12:58:08.920019 30473 leader_election.cc:302] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 024f4554bf6047339a42e48ee66224ae, 86ed061e789746079d8333a59e291dbb, dd529fdbfb5945fc8b37d8072a1cf6e8; no voters:
I20260924 12:58:08.920747 30738 raft_consensus.cc:2781] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:58:08.920971 30738 raft_consensus.cc:482] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:58:08.921131 30738 raft_consensus.cc:3037] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:08.923486 30738 raft_consensus.cc:504] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024f4554bf6047339a42e48ee66224ae" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 41281 } } peers { permanent_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45623 } } peers { permanent_uuid: "86ed061e789746079d8333a59e291dbb" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40665 } }
I20260924 12:58:08.924214 30738 leader_election.cc:288] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [CANDIDATE]: Term 1 election: Requested vote from peers 024f4554bf6047339a42e48ee66224ae (127.11.49.67:41281), 86ed061e789746079d8333a59e291dbb (127.11.49.65:40665)
I20260924 12:58:08.925218 30406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "706cca7c808f4ae896c207c0f93a34d5" candidate_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ed061e789746079d8333a59e291dbb"
I20260924 12:58:08.925216 30668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "706cca7c808f4ae896c207c0f93a34d5" candidate_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024f4554bf6047339a42e48ee66224ae"
I20260924 12:58:08.925598 30406 raft_consensus.cc:3037] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:08.925573 30668 raft_consensus.cc:3037] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:08.929664 30406 raft_consensus.cc:2454] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd529fdbfb5945fc8b37d8072a1cf6e8 in term 1.
I20260924 12:58:08.929664 30668 raft_consensus.cc:2454] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd529fdbfb5945fc8b37d8072a1cf6e8 in term 1.
I20260924 12:58:08.930464 30472 leader_election.cc:302] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 024f4554bf6047339a42e48ee66224ae, 86ed061e789746079d8333a59e291dbb, dd529fdbfb5945fc8b37d8072a1cf6e8; no voters:
I20260924 12:58:08.931012 30738 raft_consensus.cc:2781] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:08.931625 30738 raft_consensus.cc:686] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 1 LEADER]: Becoming Leader. State: Replica: dd529fdbfb5945fc8b37d8072a1cf6e8, State: Running, Role: LEADER
I20260924 12:58:08.932245 30738 consensus_queue.cc:237] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024f4554bf6047339a42e48ee66224ae" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 41281 } } peers { permanent_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45623 } } peers { permanent_uuid: "86ed061e789746079d8333a59e291dbb" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40665 } }
I20260924 12:58:08.937530 30265 catalog_manager.cc:5495] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd529fdbfb5945fc8b37d8072a1cf6e8 (127.11.49.66). New cstate: current_term: 1 leader_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024f4554bf6047339a42e48ee66224ae" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd529fdbfb5945fc8b37d8072a1cf6e8" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ed061e789746079d8333a59e291dbb" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40665 } health_report { overall_health: UNKNOWN } } }
W20260924 12:58:08.952586 30714 tablet.cc:2369] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:58:08.976428 30731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:08.968160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42912 (local address 127.11.49.66:45623)
0924 12:58:08.968495 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:08.968503 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:08.968835 (+ 332us) server_negotiation.cc:407] Connection header received
0924 12:58:08.969059 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:08.969064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:08.969188 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:08.969378 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:58:08.970242 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.971134 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.972869 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:08.973376 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:08.973546 (+ 170us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:08.974374 (+ 828us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:58:08.975091 (+ 717us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:58:08.975283 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:08.975743 (+ 460us) server_negotiation.cc:299] Negotiation successful
0924 12:58:08.976013 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260924 12:58:08.988879 30668 raft_consensus.cc:1261] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae [term 1 FOLLOWER]: Refusing update from remote peer dd529fdbfb5945fc8b37d8072a1cf6e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:58:08.988967 30406 raft_consensus.cc:1261] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb [term 1 FOLLOWER]: Refusing update from remote peer dd529fdbfb5945fc8b37d8072a1cf6e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:58:08.990507 30743 consensus_queue.cc:1035] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024f4554bf6047339a42e48ee66224ae" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:58:08.991019 30738 consensus_queue.cc:1035] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ed061e789746079d8333a59e291dbb" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 40665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:58:09.007763 30746 mvcc.cc:205] Tried to move back new op lower bound from 7332883206083481600 to 7332883205870895104. Current Snapshot: MvccSnapshot[applied={T|T < 7332883206083481600}]
I20260924 12:58:09.024191 30264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:58:09.024592 30264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:58:09.029554 30264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bda845ba5b1e48fda89b8976cf7cd501: Sending DeleteTablet for 3 replicas of tablet 706cca7c808f4ae896c207c0f93a34d5
I20260924 12:58:09.030965 30648 tablet_service.cc:1514] Processing DeleteTablet for tablet 706cca7c808f4ae896c207c0f93a34d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:09 UTC) from {username='slave'} at 127.0.0.1:38698
I20260924 12:58:09.031009 30386 tablet_service.cc:1514] Processing DeleteTablet for tablet 706cca7c808f4ae896c207c0f93a34d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:09 UTC) from {username='slave'} at 127.0.0.1:58024
I20260924 12:58:09.031265 30517 tablet_service.cc:1514] Processing DeleteTablet for tablet 706cca7c808f4ae896c207c0f93a34d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:09 UTC) from {username='slave'} at 127.0.0.1:42902
I20260924 12:58:09.036521 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 30324
I20260924 12:58:09.050194 30758 tablet_replica.cc:330] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: stopping tablet replica
I20260924 12:58:09.050868 30758 raft_consensus.cc:2229] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:58:09.051741 30758 raft_consensus.cc:2258] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:09.057869 30758 ts_tablet_manager.cc:1905] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:09.065671 30757 tablet_replica.cc:330] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb: stopping tablet replica
I20260924 12:58:09.066376 30757 raft_consensus.cc:2229] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:58:09.067090 30757 raft_consensus.cc:2258] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:09.068041 30756 tablet_replica.cc:330] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: stopping tablet replica
I20260924 12:58:09.068665 30756 raft_consensus.cc:2229] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:58:09.069248 30756 raft_consensus.cc:2258] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:09.070578 30757 ts_tablet_manager.cc:1905] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:09.070825 30758 ts_tablet_manager.cc:1918] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:09.071060 30758 log.cc:1196] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/706cca7c808f4ae896c207c0f93a34d5
I20260924 12:58:09.071741 30758 ts_tablet_manager.cc:1939] T 706cca7c808f4ae896c207c0f93a34d5 P dd529fdbfb5945fc8b37d8072a1cf6e8: Deleting consensus metadata
I20260924 12:58:09.072427 30756 ts_tablet_manager.cc:1905] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:09.073877 30249 catalog_manager.cc:4841] TS dd529fdbfb5945fc8b37d8072a1cf6e8 (127.11.49.66:45623): tablet 706cca7c808f4ae896c207c0f93a34d5 (table test-table [id=3c00fde349644002bd44c137484d152c]) successfully deleted
I20260924 12:58:09.078311 30729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:09.037675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58038 (local address 127.11.49.65:40665)
0924 12:58:09.037913 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:09.037921 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:09.058429 (+ 20508us) server_negotiation.cc:407] Connection header received
0924 12:58:09.059075 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:09.059085 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:09.059235 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:09.059339 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:09.060437 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:09.062049 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:09.068650 (+ 6601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:09.069310 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:09.069451 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:09.075728 (+ 6277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:09.075743 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:09.075762 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:09.076758 (+ 996us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:09.076846 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:09.076882 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:09.077016 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:09.077697 (+ 681us) server_negotiation.cc:299] Negotiation successful
0924 12:58:09.077849 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260924 12:58:09.080041 30446 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:09.080408 30756 ts_tablet_manager.cc:1918] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:09.080688 30756 log.cc:1196] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/706cca7c808f4ae896c207c0f93a34d5
I20260924 12:58:09.081343 30756 ts_tablet_manager.cc:1939] T 706cca7c808f4ae896c207c0f93a34d5 P 024f4554bf6047339a42e48ee66224ae: Deleting consensus metadata
I20260924 12:58:09.083841 30251 catalog_manager.cc:4841] TS 024f4554bf6047339a42e48ee66224ae (127.11.49.67:41281): tablet 706cca7c808f4ae896c207c0f93a34d5 (table test-table [id=3c00fde349644002bd44c137484d152c]) successfully deleted
I20260924 12:58:09.223133 30757 ts_tablet_manager.cc:1918] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:09.223508 30757 log.cc:1196] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/706cca7c808f4ae896c207c0f93a34d5
I20260924 12:58:09.224099 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 30324
I20260924 12:58:09.224220 30757 ts_tablet_manager.cc:1939] T 706cca7c808f4ae896c207c0f93a34d5 P 86ed061e789746079d8333a59e291dbb: Deleting consensus metadata
I20260924 12:58:09.252041 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 30455
W20260924 12:58:09.252553 30252 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.49.65:40665 (error 108)
I20260924 12:58:09.254896 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:09.254302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40665 (local address 127.0.0.1:58048)
0924 12:58:09.254499 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:09.254673 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:40665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260924 12:58:09.255370 30252 catalog_manager.cc:4584] TS 86ed061e789746079d8333a59e291dbb (127.11.49.65:40665): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 706cca7c808f4ae896c207c0f93a34d5: Network error: Client connection negotiation failed: client connection to 127.11.49.65:40665: connect: Connection refused (error 111)
I20260924 12:58:09.263011 30731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:09.253876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42924 (local address 127.11.49.66:45623)
0924 12:58:09.254174 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:09.254185 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:09.254215 (+ 30us) server_negotiation.cc:407] Connection header received
0924 12:58:09.254334 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:09.254342 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:09.254483 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:09.254675 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:09.255327 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:09.256428 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:09.258643 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:09.259169 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:09.259286 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:09.260957 (+ 1671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:09.260973 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:09.260993 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:09.262074 (+ 1081us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:09.262144 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:09.262173 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:09.262299 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:09.262498 (+ 199us) server_negotiation.cc:299] Negotiation successful
0924 12:58:09.262628 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260924 12:58:09.264107 30577 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:09.309588 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:09.308741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40665 (local address 127.0.0.1:58064)
0924 12:58:09.309110 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:09.309303 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:40665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260924 12:58:09.311035 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:09.310505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40665 (local address 127.0.0.1:58066)
0924 12:58:09.310727 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:09.310846 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:40665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260924 12:58:09.372196 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:09.371397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40665 (local address 127.0.0.1:58068)
0924 12:58:09.371756 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:09.371932 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:40665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260924 12:58:09.374043 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:09.373166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40665 (local address 127.0.0.1:58072)
0924 12:58:09.373376 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:09.373836 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:40665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260924 12:58:09.403806 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 30455
I20260924 12:58:09.429736 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 30586
I20260924 12:58:09.438570 30763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:09.430813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38702 (local address 127.11.49.67:41281)
0924 12:58:09.431377 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:09.431382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:09.431485 (+ 103us) server_negotiation.cc:407] Connection header received
0924 12:58:09.431563 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:09.431567 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:09.431657 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:09.431770 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:09.432478 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:09.433233 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:09.434887 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:09.435328 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:09.435486 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:09.437072 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:09.437081 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:09.437095 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:09.437704 (+ 609us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:09.437758 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:09.437779 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:09.437884 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:09.438070 (+ 186us) server_negotiation.cc:299] Negotiation successful
0924 12:58:09.438173 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":317,"threads_started":1}
I20260924 12:58:09.439512 30708 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:09.455241 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:09.454592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40665 (local address 127.0.0.1:58078)
0924 12:58:09.454899 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:09.455002 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:40665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260924 12:58:09.456959 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:09.456354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40665 (local address 127.0.0.1:58092)
0924 12:58:09.456685 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:09.456783 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:40665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189}
I20260924 12:58:09.538664 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 30586
I20260924 12:58:09.559141 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 30234
I20260924 12:58:09.560768 30295 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:09.679641 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:09.678973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:40665 (local address 127.0.0.1:58100)
0924 12:58:09.679200 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:09.679368 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.65:40665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260924 12:58:09.680089 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 30234
2026-09-24T12:58:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3451 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:09 dist-test-slave-m9hg krb5kdc[30768](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:09 dist-test-slave-m9hg krb5kdc[30768](info): set up 2 sockets
Sep 24 12:58:09 dist-test-slave-m9hg krb5kdc[30768](info): commencing operation
krb5kdc: starting...
W20260924 12:58:10.833325 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.003s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:11 dist-test-slave-m9hg krb5kdc[30768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:58:11.148345 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:33501
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:33501
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:11.526079 30781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:11.526518 30781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:11.526732 30781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:11.535704 30781 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:11.535892 30781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:11.536031 30781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:11.536139 30781 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:11.536214 30781 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:11.549093 30781 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:33501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:33501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:11.551017 30781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:11.552932 30781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:11.568511 30786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:11.568529 30787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:11.568451 30789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:11.570393 30781 server_base.cc:1034] running on GCE node
I20260924 12:58:11.571493 30781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:11.573586 30781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:11.574929 30781 hybrid_clock.cc:648] HybridClock initialized: now 1790254691574835 us; error 92 us; skew 500 ppm
I20260924 12:58:11.575493 30781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:11 dist-test-slave-m9hg krb5kdc[30768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254691, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:11.579676 30781 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:58:11.581756 30781 webserver.cc:460] Webserver started at http://127.11.49.126:43507/ using document root <none> and password file <none>
I20260924 12:58:11.582952 30781 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:11.583156 30781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:11.583617 30781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:11.590029 30781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "13a95d6c51a04d87a0bf8211b9e738a4"
format_stamp: "Formatted at 2026-09-24 12:58:11 on dist-test-slave-m9hg"
server_key: "8f572b29fc2024079d1354dc25cd2fd9"
server_key_iv: "600cc27d6a3ee1dcf6eae40586342187"
server_key_version: "encryptionkey@0"
I20260924 12:58:11.591492 30781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "13a95d6c51a04d87a0bf8211b9e738a4"
format_stamp: "Formatted at 2026-09-24 12:58:11 on dist-test-slave-m9hg"
server_key: "8f572b29fc2024079d1354dc25cd2fd9"
server_key_iv: "600cc27d6a3ee1dcf6eae40586342187"
server_key_version: "encryptionkey@0"
I20260924 12:58:11.600033 30781 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.001s
I20260924 12:58:11.605152 30796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:11.607254 30781 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:58:11.607508 30781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "13a95d6c51a04d87a0bf8211b9e738a4"
format_stamp: "Formatted at 2026-09-24 12:58:11 on dist-test-slave-m9hg"
server_key: "8f572b29fc2024079d1354dc25cd2fd9"
server_key_iv: "600cc27d6a3ee1dcf6eae40586342187"
server_key_version: "encryptionkey@0"
I20260924 12:58:11.607769 30781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:11.637989 30781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:11.644380 30781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:11.644754 30781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:11.669181 30781 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:33501
I20260924 12:58:11.669229 30847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:33501 every 8 connection(s)
I20260924 12:58:11.671008 30781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:11.672564 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 30781
I20260924 12:58:11.672771 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:11.673372 11461 external_mini_cluster.cc:1428] Setting key a57d0103d60a0e2db7397ef60fe705f3
I20260924 12:58:11.676667 30848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:11.690773 30848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4: Bootstrap starting.
Sep 24 12:58:11 dist-test-slave-m9hg krb5kdc[30768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:58:11.694918 30848 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:11.696482 30848 log.cc:824] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:11.700745 30848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4: No bootstrap required, opened a new log
I20260924 12:58:11.704118 30851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:11.675878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53330 (local address 127.11.49.126:33501)
0924 12:58:11.676945 (+ 1067us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:11.676964 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:11.677027 (+ 63us) server_negotiation.cc:407] Connection header received
0924 12:58:11.679571 (+ 2544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:11.679598 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:11.680149 (+ 551us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:11.680684 (+ 535us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:11.682538 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:11.684664 (+ 2126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:11.686341 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:11.687511 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:11.687756 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:11.693388 (+ 5632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:11.693401 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:11.693421 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:11.693477 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:11.698307 (+ 4830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:11.699497 (+ 1190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:11.699507 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:11.699515 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:11.699757 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:11.700455 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:11.700459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:11.700463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:11.701223 (+ 760us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:11.701583 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:11.702138 (+ 555us) server_negotiation.cc:299] Negotiation successful
0924 12:58:11.702672 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":781,"thread_start_us":471,"threads_started":1}
I20260924 12:58:11.710585 30848 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a95d6c51a04d87a0bf8211b9e738a4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33501 } }
I20260924 12:58:11.710994 30848 raft_consensus.cc:374] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:11.711069 30848 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13a95d6c51a04d87a0bf8211b9e738a4, State: Initialized, Role: FOLLOWER
I20260924 12:58:11.711653 30848 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a95d6c51a04d87a0bf8211b9e738a4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33501 } }
I20260924 12:58:11.711874 30848 raft_consensus.cc:388] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:11.711968 30848 raft_consensus.cc:482] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:11.712116 30848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:11.714890 30848 raft_consensus.cc:504] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a95d6c51a04d87a0bf8211b9e738a4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33501 } }
I20260924 12:58:11.715386 30848 leader_election.cc:302] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13a95d6c51a04d87a0bf8211b9e738a4; no voters:
I20260924 12:58:11.716008 30848 leader_election.cc:288] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:11.716375 30853 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:11.717455 30853 raft_consensus.cc:686] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [term 1 LEADER]: Becoming Leader. State: Replica: 13a95d6c51a04d87a0bf8211b9e738a4, State: Running, Role: LEADER
I20260924 12:58:11.718430 30848 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:11.718299 30853 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a95d6c51a04d87a0bf8211b9e738a4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33501 } }
I20260924 12:58:11.724468 30855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13a95d6c51a04d87a0bf8211b9e738a4. Latest consensus state: current_term: 1 leader_uuid: "13a95d6c51a04d87a0bf8211b9e738a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a95d6c51a04d87a0bf8211b9e738a4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33501 } } }
I20260924 12:58:11.724946 30855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:11.725541 30854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13a95d6c51a04d87a0bf8211b9e738a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a95d6c51a04d87a0bf8211b9e738a4" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33501 } } }
I20260924 12:58:11.726177 30854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:11.730295 30869 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260924 12:58:11.731778 30863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:11.736662 30863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:11.747985 30863 catalog_manager.cc:1347] Generated new cluster ID: f2e7435e5b4b4918a7b379e5bec4ee8e
I20260924 12:58:11.748142 30863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:11.760660 30863 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:11.762183 30863 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:11.777088 30863 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4: Generated new TSK 0
I20260924 12:58:11.778209 30863 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.49.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
Entry for principal kudu/127.11.49.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab.
I20260924 12:58:11.862205 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33501
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:12.216603 30874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:12.216964 30874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:12.217133 30874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:12.224947 30874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:12.225150 30874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:12.225369 30874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:58:12.235981 30874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.65.keytab
--principal=kudu/127.11.49.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33501
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:12.237382 30874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:12.238696 30874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:12.255712 30879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:12.256170 30880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:12.256209 30882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:12.258157 30874 server_base.cc:1034] running on GCE node
I20260924 12:58:12.259076 30874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:12.260447 30874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:12.261776 30874 hybrid_clock.cc:648] HybridClock initialized: now 1790254692261714 us; error 54 us; skew 500 ppm
I20260924 12:58:12.262256 30874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:12 dist-test-slave-m9hg krb5kdc[30768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254692, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:12.266449 30874 init.cc:377] Logged in from keytab as kudu/127.11.49.65@KRBTEST.COM (short username kudu)
I20260924 12:58:12.268757 30874 webserver.cc:460] Webserver started at http://127.11.49.65:46507/ using document root <none> and password file <none>
I20260924 12:58:12.269726 30874 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:12.269898 30874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:12.270332 30874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:12.274348 30874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "f76e4735ea244f0cb7181e7c8d811a38"
format_stamp: "Formatted at 2026-09-24 12:58:12 on dist-test-slave-m9hg"
server_key: "d4ce196639c08bb12c5a67ad13e019c1"
server_key_iv: "1c94e3c261548507e6665ab44282634e"
server_key_version: "encryptionkey@0"
I20260924 12:58:12.275547 30874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "f76e4735ea244f0cb7181e7c8d811a38"
format_stamp: "Formatted at 2026-09-24 12:58:12 on dist-test-slave-m9hg"
server_key: "d4ce196639c08bb12c5a67ad13e019c1"
server_key_iv: "1c94e3c261548507e6665ab44282634e"
server_key_version: "encryptionkey@0"
I20260924 12:58:12.283777 30874 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.010s sys 0.000s
I20260924 12:58:12.288929 30889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:12.290977 30874 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:58:12.291296 30874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "f76e4735ea244f0cb7181e7c8d811a38"
format_stamp: "Formatted at 2026-09-24 12:58:12 on dist-test-slave-m9hg"
server_key: "d4ce196639c08bb12c5a67ad13e019c1"
server_key_iv: "1c94e3c261548507e6665ab44282634e"
server_key_version: "encryptionkey@0"
I20260924 12:58:12.291615 30874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:12.315300 30874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:12.321444 30874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:12.321846 30874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:12.323232 30874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:12.325134 30874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:12.325254 30874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:12.325448 30874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:12.325522 30874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:12.366529 30874 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:42075
I20260924 12:58:12.366596 31001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:42075 every 8 connection(s)
I20260924 12:58:12.368201 30874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:58:12.369441 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 30874
I20260924 12:58:12.369650 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:58:12.370292 11461 external_mini_cluster.cc:1428] Setting key fee4334c13eaa19b06704d8739ca33eb
Sep 24 12:58:12 dist-test-slave-m9hg krb5kdc[30768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254692, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.65@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:58:12.397979 31004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:12.371817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:35133 (local address 127.11.49.126:33501)
0924 12:58:12.372470 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:12.372477 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:12.374058 (+ 1581us) server_negotiation.cc:407] Connection header received
0924 12:58:12.377437 (+ 3379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:12.377443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:12.377585 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:12.377732 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:12.380157 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:12.381153 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:12.383755 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:12.384629 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:12.384848 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:12.389440 (+ 4592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:12.389450 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:12.389458 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:12.389542 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:12.393650 (+ 4108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:12.394644 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:12.394654 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:12.394660 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:12.394861 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:12.395382 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:12.395390 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:12.395396 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:12.395872 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:12.396058 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:12.397023 (+ 965us) server_negotiation.cc:299] Negotiation successful
0924 12:58:12.397390 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":304,"threads_started":1}
I20260924 12:58:12.398746 31005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:12.372709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:33501 (local address 127.11.49.65:35133)
0924 12:58:12.373795 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:12.373870 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:12.376970 (+ 3100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:12.378051 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:12.378066 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:12.378945 (+ 879us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:12.379874 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:12.379907 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:12.381368 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:12.381377 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:12.383527 (+ 2150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:12.383540 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:12.385002 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:12.385008 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:12.385247 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:12.386174 (+ 927us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:58:12.386202 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:12.389072 (+ 2870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:12.393892 (+ 4820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:12.393902 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:12.393917 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:12.394474 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:12.395020 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:12.395024 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:12.395026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:12.395252 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:12.396071 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:12.396080 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:12.396584 (+ 504us) client_negotiation.cc:769] Sending connection context
0924 12:58:12.396842 (+ 258us) client_negotiation.cc:240] Negotiation successful
0924 12:58:12.397418 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"thread_start_us":410,"threads_started":1}
I20260924 12:58:12.400820 31002 heartbeater.cc:347] Connected to a master server at 127.11.49.126:33501
I20260924 12:58:12.401396 31002 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:12.402679 31002 heartbeater.cc:511] Master 127.11.49.126:33501 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.49.66@KRBTEST.COM; defaulting to no policy
I20260924 12:58:12.405952 30813 ts_manager.cc:194] Registered new tserver with Master: f76e4735ea244f0cb7181e7c8d811a38 (127.11.49.65:42075)
I20260924 12:58:12.407712 30813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.65@KRBTEST.COM'} at 127.11.49.65:35133
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
Entry for principal kudu/127.11.49.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab.
I20260924 12:58:12.445040 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33501
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:12.890098 31008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:12.890496 31008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:12.890606 31008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:12.899652 31008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:12.900010 31008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:12.900218 31008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:58:12.913339 31008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.66.keytab
--principal=kudu/127.11.49.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33501
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:12.915140 31008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:12.916867 31008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:12.935381 31013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:12.935657 31014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:12.935698 31016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:12.937567 31008 server_base.cc:1034] running on GCE node
I20260924 12:58:12.938619 31008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:12.940091 31008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:12.941496 31008 hybrid_clock.cc:648] HybridClock initialized: now 1790254692941425 us; error 67 us; skew 500 ppm
I20260924 12:58:12.941985 31008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:12 dist-test-slave-m9hg krb5kdc[30768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254692, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:12.946557 31008 init.cc:377] Logged in from keytab as kudu/127.11.49.66@KRBTEST.COM (short username kudu)
I20260924 12:58:12.948824 31008 webserver.cc:460] Webserver started at http://127.11.49.66:38937/ using document root <none> and password file <none>
I20260924 12:58:12.949775 31008 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:12.949914 31008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:12.950253 31008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:12.954095 31008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "cc5f5f55e1e0413c8554519da9ac010a"
format_stamp: "Formatted at 2026-09-24 12:58:12 on dist-test-slave-m9hg"
server_key: "4be3a3f780a30c9deb580f38276d205c"
server_key_iv: "73b90d85701ac05e1453b4c3a0e727f4"
server_key_version: "encryptionkey@0"
I20260924 12:58:12.955067 31008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "cc5f5f55e1e0413c8554519da9ac010a"
format_stamp: "Formatted at 2026-09-24 12:58:12 on dist-test-slave-m9hg"
server_key: "4be3a3f780a30c9deb580f38276d205c"
server_key_iv: "73b90d85701ac05e1453b4c3a0e727f4"
server_key_version: "encryptionkey@0"
I20260924 12:58:12.962594 31008 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260924 12:58:12.967911 31023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:12.970079 31008 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260924 12:58:12.970330 31008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "cc5f5f55e1e0413c8554519da9ac010a"
format_stamp: "Formatted at 2026-09-24 12:58:12 on dist-test-slave-m9hg"
server_key: "4be3a3f780a30c9deb580f38276d205c"
server_key_iv: "73b90d85701ac05e1453b4c3a0e727f4"
server_key_version: "encryptionkey@0"
I20260924 12:58:12.970575 31008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:13.004309 31008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:13.009837 31008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:13.010175 31008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:13.011452 31008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:13.013422 31008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:13.013515 31008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:13.013628 31008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:13.013697 31008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:13.056866 31008 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:45125
I20260924 12:58:13.056880 31135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:45125 every 8 connection(s)
I20260924 12:58:13.058569 31008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:58:13.060725 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 31008
I20260924 12:58:13.060943 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:58:13.061658 11461 external_mini_cluster.cc:1428] Setting key 61c989ddaa8926b7c17225120d470a76
Sep 24 12:58:13 dist-test-slave-m9hg krb5kdc[30768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254692, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.66@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:58:13.087474 31138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.062081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:38535 (local address 127.11.49.126:33501)
0924 12:58:13.062622 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:13.062627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:13.064124 (+ 1497us) server_negotiation.cc:407] Connection header received
0924 12:58:13.066654 (+ 2530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:13.066663 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:13.066790 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:13.066952 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:13.069219 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.070465 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.072507 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.073278 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.073455 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.079651 (+ 6196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:13.079657 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:13.079662 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:13.079708 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:13.082791 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:13.084199 (+ 1408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:13.084204 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:13.084207 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:13.084454 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:13.085153 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:13.085157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:13.085160 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:13.085509 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:13.085663 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:13.086920 (+ 1257us) server_negotiation.cc:299] Negotiation successful
0924 12:58:13.087155 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":297,"threads_started":1}
I20260924 12:58:13.089341 31139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.062888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:33501 (local address 127.11.49.66:38535)
0924 12:58:13.063908 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:13.063964 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:13.066282 (+ 2318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:13.067294 (+ 1012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:13.067304 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:13.067981 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:13.068964 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.068987 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.070700 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.070705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.072236 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.072251 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.073667 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.073684 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.074110 (+ 426us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.075262 (+ 1152us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:58:13.075308 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:13.079248 (+ 3940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:13.083034 (+ 3786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:13.083051 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:13.083079 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:13.083968 (+ 889us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:13.084594 (+ 626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:13.084602 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:13.084608 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:13.084914 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:13.085671 (+ 757us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:13.085684 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:13.086335 (+ 651us) client_negotiation.cc:769] Sending connection context
0924 12:58:13.086728 (+ 393us) client_negotiation.cc:240] Negotiation successful
0924 12:58:13.087492 (+ 764us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":454,"threads_started":1}
I20260924 12:58:13.091389 31136 heartbeater.cc:347] Connected to a master server at 127.11.49.126:33501
I20260924 12:58:13.091849 31136 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:13.092864 31136 heartbeater.cc:511] Master 127.11.49.126:33501 requested a full tablet report, sending...
I20260924 12:58:13.094781 30813 ts_manager.cc:194] Registered new tserver with Master: cc5f5f55e1e0413c8554519da9ac010a (127.11.49.66:45125)
WARNING: no policy specified for kudu/127.11.49.67@KRBTEST.COM; defaulting to no policy
I20260924 12:58:13.095830 30813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.66@KRBTEST.COM'} at 127.11.49.66:38535
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
Entry for principal kudu/127.11.49.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab.
I20260924 12:58:13.136709 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33501
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:36725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:58:13.412053 31002 heartbeater.cc:503] Master 127.11.49.126:33501 was elected leader, sending a full tablet report...
W20260924 12:58:13.562949 31142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:13.563370 31142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:13.563555 31142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:13.572211 31142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:13.572412 31142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:13.572638 31142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:58:13.585675 31142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:36725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.67.keytab
--principal=kudu/127.11.49.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:33501
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:13.587687 31142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:13.590293 31142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:13.609733 31147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:13.609745 31150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:13.609956 31148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:13.614449 31142 server_base.cc:1034] running on GCE node
I20260924 12:58:13.615367 31142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:13.616688 31142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:13.617946 31142 hybrid_clock.cc:648] HybridClock initialized: now 1790254693617895 us; error 56 us; skew 500 ppm
I20260924 12:58:13.618396 31142 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:13 dist-test-slave-m9hg krb5kdc[30768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254693, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:13.622068 31142 init.cc:377] Logged in from keytab as kudu/127.11.49.67@KRBTEST.COM (short username kudu)
I20260924 12:58:13.623987 31142 webserver.cc:460] Webserver started at http://127.11.49.67:35595/ using document root <none> and password file <none>
I20260924 12:58:13.624912 31142 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:13.625026 31142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:13.625422 31142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:13.628628 31142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "d3efb0ec06a143f988630032ffcb84f1"
format_stamp: "Formatted at 2026-09-24 12:58:13 on dist-test-slave-m9hg"
server_key: "d3ad814ebfed0ac71a2fe5233cf7391d"
server_key_iv: "a60ef33d024e3d7c3309e7efb8394809"
server_key_version: "encryptionkey@0"
I20260924 12:58:13.629451 31142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "d3efb0ec06a143f988630032ffcb84f1"
format_stamp: "Formatted at 2026-09-24 12:58:13 on dist-test-slave-m9hg"
server_key: "d3ad814ebfed0ac71a2fe5233cf7391d"
server_key_iv: "a60ef33d024e3d7c3309e7efb8394809"
server_key_version: "encryptionkey@0"
I20260924 12:58:13.635808 31142 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260924 12:58:13.640564 31157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:13.642442 31142 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:58:13.642681 31142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "d3efb0ec06a143f988630032ffcb84f1"
format_stamp: "Formatted at 2026-09-24 12:58:13 on dist-test-slave-m9hg"
server_key: "d3ad814ebfed0ac71a2fe5233cf7391d"
server_key_iv: "a60ef33d024e3d7c3309e7efb8394809"
server_key_version: "encryptionkey@0"
I20260924 12:58:13.642953 31142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:13.666797 31142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:13.671703 31142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:13.672039 31142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:13.673262 31142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:13.674830 31142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:13.674949 31142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:13.675099 31142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:13.675170 31142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:13.717093 31142 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:38137
I20260924 12:58:13.717227 31269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:38137 every 8 connection(s)
I20260924 12:58:13.718678 31142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:58:13.722699 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 31142
I20260924 12:58:13.722980 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:58:13.724053 11461 external_mini_cluster.cc:1428] Setting key f987ab6495c720ed3005cf0916dd1337
Sep 24 12:58:13 dist-test-slave-m9hg krb5kdc[30768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254693, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.67@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:58:13.744201 31272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.722836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:51331 (local address 127.11.49.126:33501)
0924 12:58:13.725574 (+ 2738us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:13.725582 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:13.725610 (+ 28us) server_negotiation.cc:407] Connection header received
0924 12:58:13.727198 (+ 1588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:13.727204 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:13.727348 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:13.727488 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:13.729467 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.730353 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.732108 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.732699 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.732855 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.736992 (+ 4137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:13.736997 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:13.737001 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:13.737037 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:13.740524 (+ 3487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:13.741462 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:13.741467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:13.741470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:13.741617 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:13.742148 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:13.742152 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:13.742155 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:13.742466 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:13.742656 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:13.743453 (+ 797us) server_negotiation.cc:299] Negotiation successful
0924 12:58:13.743751 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2580,"thread_start_us":2322,"threads_started":1}
I20260924 12:58:13.745453 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.723527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:33501 (local address 127.11.49.67:51331)
0924 12:58:13.724654 (+ 1127us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:13.724714 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:13.726867 (+ 2153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:13.727773 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:13.727782 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:13.728474 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:13.729273 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.729294 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.730529 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.730540 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.731943 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.731957 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.732960 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.732970 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.733225 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.734037 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:58:13.734067 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:13.736709 (+ 2642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:13.740725 (+ 4016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:13.740737 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:13.740758 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:13.741295 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:13.741761 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:58:13.741767 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:58:13.741771 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:58:13.741999 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:58:13.742613 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:13.742622 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:13.743032 (+ 410us) client_negotiation.cc:769] Sending connection context
0924 12:58:13.743348 (+ 316us) client_negotiation.cc:240] Negotiation successful
0924 12:58:13.743960 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"thread_start_us":430,"threads_started":1}
I20260924 12:58:13.747535 31270 heartbeater.cc:347] Connected to a master server at 127.11.49.126:33501
I20260924 12:58:13.748036 31270 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:13.748991 31270 heartbeater.cc:511] Master 127.11.49.126:33501 requested a full tablet report, sending...
I20260924 12:58:13.750996 30813 ts_manager.cc:194] Registered new tserver with Master: d3efb0ec06a143f988630032ffcb84f1 (127.11.49.67:38137)
I20260924 12:58:13.752379 30813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.49.67@KRBTEST.COM'} at 127.11.49.67:51331
I20260924 12:58:13.754988 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:58:13.777539 31272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.760806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53346 (local address 127.11.49.126:33501)
0924 12:58:13.761074 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:13.761080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:13.761711 (+ 631us) server_negotiation.cc:407] Connection header received
0924 12:58:13.761879 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:13.761884 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:13.761961 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:13.762053 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:13.763961 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.765016 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.766860 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.767433 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.767563 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.770712 (+ 3149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:13.770717 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:13.770721 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:13.770766 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:13.773977 (+ 3211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:13.775061 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:13.775065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:13.775068 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:13.775221 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:13.775703 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:13.775707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:13.775709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:13.776178 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:13.776499 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:13.776942 (+ 443us) server_negotiation.cc:299] Negotiation successful
0924 12:58:13.777188 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260924 12:58:13.783077 30812 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:58:13.790474 30812 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:58:13.831542 31287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.806830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56588 (local address 127.11.49.66:45125)
0924 12:58:13.819042 (+ 12212us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:13.819054 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:13.821604 (+ 2550us) server_negotiation.cc:407] Connection header received
0924 12:58:13.821737 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:13.821746 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:13.822036 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:13.822267 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:13.823415 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.824976 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.828483 (+ 3507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.830048 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.830217 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.830447 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:13.830958 (+ 511us) server_negotiation.cc:299] Negotiation successful
0924 12:58:13.831146 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11992,"thread_start_us":11824,"threads_started":1}
I20260924 12:58:13.831676 31283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.806567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:38137 (local address 127.0.0.1:38574)
0924 12:58:13.821587 (+ 15020us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:13.821619 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:13.821931 (+ 312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:13.822803 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:13.822811 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:13.822910 (+ 99us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:13.823497 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.823511 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.825898 (+ 2387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.825905 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.828338 (+ 2433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.828363 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.830676 (+ 2313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.830682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.830819 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.830903 (+ 84us) client_negotiation.cc:769] Sending connection context
0924 12:58:13.831014 (+ 111us) client_negotiation.cc:240] Negotiation successful
0924 12:58:13.831209 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14843,"mutex_wait_us":114,"thread_start_us":12752,"threads_started":1}
I20260924 12:58:13.831817 31288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.807193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38574 (local address 127.11.49.67:38137)
0924 12:58:13.818197 (+ 11004us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:13.818212 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:13.821762 (+ 3550us) server_negotiation.cc:407] Connection header received
0924 12:58:13.822221 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:13.822231 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:13.822515 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:13.822713 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:13.823751 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.825702 (+ 1951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.828599 (+ 2897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.830442 (+ 1843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.830616 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.830917 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:13.831083 (+ 166us) server_negotiation.cc:299] Negotiation successful
0924 12:58:13.831329 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10730,"thread_start_us":11024,"threads_started":1}
I20260924 12:58:13.832509 31286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.806145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:42075 (local address 127.0.0.1:49030)
0924 12:58:13.819740 (+ 13595us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:13.819827 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:13.820682 (+ 855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:13.822197 (+ 1515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:13.822206 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:13.822241 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:13.823105 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.823132 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.825640 (+ 2508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.825645 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.828299 (+ 2654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.828309 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.831291 (+ 2982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.831297 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.831537 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.831579 (+ 42us) client_negotiation.cc:769] Sending connection context
0924 12:58:13.831702 (+ 123us) client_negotiation.cc:240] Negotiation successful
0924 12:58:13.831890 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13322,"mutex_wait_us":101,"thread_start_us":14387,"threads_started":1}
I20260924 12:58:13.832930 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.806224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:45125 (local address 127.0.0.1:56588)
0924 12:58:13.821316 (+ 15092us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:13.821347 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:13.821471 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:13.822386 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:13.822391 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:13.822421 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:13.823133 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.823154 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.825145 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.825150 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.828232 (+ 3082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.828251 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.830312 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.830320 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.830626 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.830694 (+ 68us) client_negotiation.cc:769] Sending connection context
0924 12:58:13.830886 (+ 192us) client_negotiation.cc:240] Negotiation successful
0924 12:58:13.832262 (+ 1376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14944,"mutex_wait_us":1232,"thread_start_us":15847,"threads_started":1}
I20260924 12:58:13.833171 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.806575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49030 (local address 127.11.49.65:42075)
0924 12:58:13.820720 (+ 14145us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:13.820732 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:13.820784 (+ 52us) server_negotiation.cc:407] Connection header received
0924 12:58:13.820950 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:13.820963 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:13.821452 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:13.821786 (+ 334us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:13.823391 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.825467 (+ 2076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.828542 (+ 3075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.830051 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.830217 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.830480 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:13.832482 (+ 2002us) server_negotiation.cc:299] Negotiation successful
0924 12:58:13.832770 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13868,"thread_start_us":13608,"threads_started":1}
I20260924 12:58:13.837680 31071 tablet_service.cc:1467] Processing CreateTablet for tablet 6e049053c125484cac385833ea507369 (DEFAULT_TABLE table=test-table [id=52f4088564ff410cb337c2cde65a061c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:13.837924 30937 tablet_service.cc:1467] Processing CreateTablet for tablet 6e049053c125484cac385833ea507369 (DEFAULT_TABLE table=test-table [id=52f4088564ff410cb337c2cde65a061c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:13.837924 31205 tablet_service.cc:1467] Processing CreateTablet for tablet 6e049053c125484cac385833ea507369 (DEFAULT_TABLE table=test-table [id=52f4088564ff410cb337c2cde65a061c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:13.839433 31071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e049053c125484cac385833ea507369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:13.839758 30937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e049053c125484cac385833ea507369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:13.839772 31205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e049053c125484cac385833ea507369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:13.853542 31289 tablet_bootstrap.cc:492] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: Bootstrap starting.
I20260924 12:58:13.858583 31290 tablet_bootstrap.cc:492] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38: Bootstrap starting.
I20260924 12:58:13.858916 31291 tablet_bootstrap.cc:492] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: Bootstrap starting.
I20260924 12:58:13.858942 31289 tablet_bootstrap.cc:654] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:13.861099 31289 log.cc:824] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:13.863582 31290 tablet_bootstrap.cc:654] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:13.863581 31291 tablet_bootstrap.cc:654] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:13.865201 31289 tablet_bootstrap.cc:492] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: No bootstrap required, opened a new log
I20260924 12:58:13.865237 31291 log.cc:824] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:13.865237 31290 log.cc:824] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:13.865669 31289 ts_tablet_manager.cc:1397] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260924 12:58:13.869729 31290 tablet_bootstrap.cc:492] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38: No bootstrap required, opened a new log
I20260924 12:58:13.870090 31290 ts_tablet_manager.cc:1397] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260924 12:58:13.872220 31291 tablet_bootstrap.cc:492] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: No bootstrap required, opened a new log
I20260924 12:58:13.872675 31291 ts_tablet_manager.cc:1397] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20260924 12:58:13.878330 31289 raft_consensus.cc:348] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76e4735ea244f0cb7181e7c8d811a38" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 42075 } } peers { permanent_uuid: "cc5f5f55e1e0413c8554519da9ac010a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45125 } } peers { permanent_uuid: "d3efb0ec06a143f988630032ffcb84f1" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 38137 } }
I20260924 12:58:13.879068 31289 raft_consensus.cc:374] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:13.879231 31289 raft_consensus.cc:729] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f5f55e1e0413c8554519da9ac010a, State: Initialized, Role: FOLLOWER
I20260924 12:58:13.878988 31290 raft_consensus.cc:348] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76e4735ea244f0cb7181e7c8d811a38" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 42075 } } peers { permanent_uuid: "cc5f5f55e1e0413c8554519da9ac010a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45125 } } peers { permanent_uuid: "d3efb0ec06a143f988630032ffcb84f1" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 38137 } }
I20260924 12:58:13.879616 31290 raft_consensus.cc:374] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:13.879776 31290 raft_consensus.cc:729] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e4735ea244f0cb7181e7c8d811a38, State: Initialized, Role: FOLLOWER
I20260924 12:58:13.880439 31289 consensus_queue.cc:260] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76e4735ea244f0cb7181e7c8d811a38" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 42075 } } peers { permanent_uuid: "cc5f5f55e1e0413c8554519da9ac010a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45125 } } peers { permanent_uuid: "d3efb0ec06a143f988630032ffcb84f1" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 38137 } }
I20260924 12:58:13.880575 31290 consensus_queue.cc:260] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76e4735ea244f0cb7181e7c8d811a38" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 42075 } } peers { permanent_uuid: "cc5f5f55e1e0413c8554519da9ac010a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45125 } } peers { permanent_uuid: "d3efb0ec06a143f988630032ffcb84f1" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 38137 } }
I20260924 12:58:13.882654 31136 heartbeater.cc:503] Master 127.11.49.126:33501 was elected leader, sending a full tablet report...
I20260924 12:58:13.882951 31290 ts_tablet_manager.cc:1428] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260924 12:58:13.883564 31289 ts_tablet_manager.cc:1428] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
I20260924 12:58:13.885455 31291 raft_consensus.cc:348] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76e4735ea244f0cb7181e7c8d811a38" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 42075 } } peers { permanent_uuid: "cc5f5f55e1e0413c8554519da9ac010a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45125 } } peers { permanent_uuid: "d3efb0ec06a143f988630032ffcb84f1" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 38137 } }
I20260924 12:58:13.886085 31291 raft_consensus.cc:374] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:13.886202 31291 raft_consensus.cc:729] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3efb0ec06a143f988630032ffcb84f1, State: Initialized, Role: FOLLOWER
I20260924 12:58:13.887068 31291 consensus_queue.cc:260] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76e4735ea244f0cb7181e7c8d811a38" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 42075 } } peers { permanent_uuid: "cc5f5f55e1e0413c8554519da9ac010a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45125 } } peers { permanent_uuid: "d3efb0ec06a143f988630032ffcb84f1" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 38137 } }
I20260924 12:58:13.888659 31270 heartbeater.cc:503] Master 127.11.49.126:33501 was elected leader, sending a full tablet report...
I20260924 12:58:13.889401 31291 ts_tablet_manager.cc:1428] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: Time spent starting tablet: real 0.017s user 0.011s sys 0.005s
W20260924 12:58:13.970930 31271 tablet.cc:2369] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:58:13.971843 31297 raft_consensus.cc:482] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:58:13.972257 31297 raft_consensus.cc:504] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76e4735ea244f0cb7181e7c8d811a38" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 42075 } } peers { permanent_uuid: "cc5f5f55e1e0413c8554519da9ac010a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45125 } } peers { permanent_uuid: "d3efb0ec06a143f988630032ffcb84f1" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 38137 } }
I20260924 12:58:13.974438 31297 leader_election.cc:288] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76e4735ea244f0cb7181e7c8d811a38 (127.11.49.65:42075), cc5f5f55e1e0413c8554519da9ac010a (127.11.49.66:45125)
I20260924 12:58:13.982920 31287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.975407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:52771 (local address 127.11.49.66:45125)
0924 12:58:13.975692 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:13.975701 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:13.975736 (+ 35us) server_negotiation.cc:407] Connection header received
0924 12:58:13.976007 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:13.976013 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:13.976113 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:13.976250 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:13.976881 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.977963 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.980128 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.981763 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.981938 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.982017 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:13.982455 (+ 438us) server_negotiation.cc:299] Negotiation successful
0924 12:58:13.982610 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260924 12:58:13.982980 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.975105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:45125 (local address 127.11.49.67:52771)
0924 12:58:13.975528 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:13.975559 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:13.975778 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:13.976412 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:13.976421 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:13.976464 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:13.976709 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.976724 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.978133 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.978139 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.979898 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.979912 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.981973 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.981982 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.982207 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.982251 (+ 44us) client_negotiation.cc:769] Sending connection context
0924 12:58:13.982421 (+ 170us) client_negotiation.cc:240] Negotiation successful
0924 12:58:13.982593 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":69}
I20260924 12:58:13.983888 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.975004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:57407 (local address 127.11.49.65:42075)
0924 12:58:13.975291 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:13.975299 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:13.976391 (+ 1092us) server_negotiation.cc:407] Connection header received
0924 12:58:13.976602 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:13.976608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:13.976693 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:13.976821 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:13.977600 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.978600 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.981560 (+ 2960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.982759 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.983016 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.983104 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:13.983531 (+ 427us) server_negotiation.cc:299] Negotiation successful
0924 12:58:13.983641 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260924 12:58:13.984195 31298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:13.975146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:42075 (local address 127.11.49.67:57407)
0924 12:58:13.976218 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:13.976248 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:13.976431 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:13.976871 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:13.976876 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:13.976904 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:13.977406 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.977419 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.978841 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.978846 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.981328 (+ 2482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:13.981352 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:13.983075 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:13.983084 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:13.983318 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:13.983362 (+ 44us) client_negotiation.cc:769] Sending connection context
0924 12:58:13.983488 (+ 126us) client_negotiation.cc:240] Negotiation successful
0924 12:58:13.983664 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":896,"mutex_wait_us":5,"thread_start_us":554,"threads_started":1}
I20260924 12:58:13.984591 31091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e049053c125484cac385833ea507369" candidate_uuid: "d3efb0ec06a143f988630032ffcb84f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f5f55e1e0413c8554519da9ac010a" is_pre_election: true
I20260924 12:58:13.985203 31091 raft_consensus.cc:2454] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3efb0ec06a143f988630032ffcb84f1 in term 0.
I20260924 12:58:13.985772 30957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e049053c125484cac385833ea507369" candidate_uuid: "d3efb0ec06a143f988630032ffcb84f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e4735ea244f0cb7181e7c8d811a38" is_pre_election: true
I20260924 12:58:13.986210 31160 leader_election.cc:302] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f5f55e1e0413c8554519da9ac010a, d3efb0ec06a143f988630032ffcb84f1; no voters:
I20260924 12:58:13.986672 30957 raft_consensus.cc:2454] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3efb0ec06a143f988630032ffcb84f1 in term 0.
I20260924 12:58:13.986935 31297 raft_consensus.cc:2781] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:58:13.987161 31297 raft_consensus.cc:482] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:58:13.987289 31297 raft_consensus.cc:3037] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:13.990423 31297 raft_consensus.cc:504] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76e4735ea244f0cb7181e7c8d811a38" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 42075 } } peers { permanent_uuid: "cc5f5f55e1e0413c8554519da9ac010a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45125 } } peers { permanent_uuid: "d3efb0ec06a143f988630032ffcb84f1" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 38137 } }
I20260924 12:58:13.991154 31297 leader_election.cc:288] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [CANDIDATE]: Term 1 election: Requested vote from peers f76e4735ea244f0cb7181e7c8d811a38 (127.11.49.65:42075), cc5f5f55e1e0413c8554519da9ac010a (127.11.49.66:45125)
I20260924 12:58:13.991791 31091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e049053c125484cac385833ea507369" candidate_uuid: "d3efb0ec06a143f988630032ffcb84f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f5f55e1e0413c8554519da9ac010a"
I20260924 12:58:13.992045 31091 raft_consensus.cc:3037] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:13.991966 30957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e049053c125484cac385833ea507369" candidate_uuid: "d3efb0ec06a143f988630032ffcb84f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e4735ea244f0cb7181e7c8d811a38"
I20260924 12:58:13.992395 30957 raft_consensus.cc:3037] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:13.994619 31091 raft_consensus.cc:2454] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3efb0ec06a143f988630032ffcb84f1 in term 1.
I20260924 12:58:13.995276 30957 raft_consensus.cc:2454] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3efb0ec06a143f988630032ffcb84f1 in term 1.
I20260924 12:58:13.995294 31160 leader_election.cc:302] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f5f55e1e0413c8554519da9ac010a, d3efb0ec06a143f988630032ffcb84f1; no voters:
I20260924 12:58:13.995719 31297 raft_consensus.cc:2781] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:13.996385 31297 raft_consensus.cc:686] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 1 LEADER]: Becoming Leader. State: Replica: d3efb0ec06a143f988630032ffcb84f1, State: Running, Role: LEADER
I20260924 12:58:13.997045 31297 consensus_queue.cc:237] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76e4735ea244f0cb7181e7c8d811a38" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 42075 } } peers { permanent_uuid: "cc5f5f55e1e0413c8554519da9ac010a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45125 } } peers { permanent_uuid: "d3efb0ec06a143f988630032ffcb84f1" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 38137 } }
I20260924 12:58:14.002404 30813 catalog_manager.cc:5495] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3efb0ec06a143f988630032ffcb84f1 (127.11.49.67). New cstate: current_term: 1 leader_uuid: "d3efb0ec06a143f988630032ffcb84f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76e4735ea244f0cb7181e7c8d811a38" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 42075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc5f5f55e1e0413c8554519da9ac010a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3efb0ec06a143f988630032ffcb84f1" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 38137 } health_report { overall_health: HEALTHY } } }
I20260924 12:58:14.040551 31288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:14.034002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38586 (local address 127.11.49.67:38137)
0924 12:58:14.034297 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:14.034303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:14.034329 (+ 26us) server_negotiation.cc:407] Connection header received
0924 12:58:14.034463 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:14.034467 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:14.034578 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:14.034790 (+ 212us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:58:14.035336 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:14.036199 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:14.037851 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:14.038313 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:14.038425 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:14.039084 (+ 659us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:58:14.039782 (+ 698us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:58:14.039913 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:14.040073 (+ 160us) server_negotiation.cc:299] Negotiation successful
0924 12:58:14.040167 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260924 12:58:14.051764 30957 raft_consensus.cc:1261] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38 [term 1 FOLLOWER]: Refusing update from remote peer d3efb0ec06a143f988630032ffcb84f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:58:14.051764 31091 raft_consensus.cc:1261] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a [term 1 FOLLOWER]: Refusing update from remote peer d3efb0ec06a143f988630032ffcb84f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:58:14.053579 31299 consensus_queue.cc:1035] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e4735ea244f0cb7181e7c8d811a38" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 42075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:58:14.054152 31297 consensus_queue.cc:1035] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f5f55e1e0413c8554519da9ac010a" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260924 12:58:14.061216 31137 tablet.cc:2369] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:58:14.071084 31302 mvcc.cc:205] Tried to move back new op lower bound from 7332883226820149248 to 7332883226616573952. Current Snapshot: MvccSnapshot[applied={T|T < 7332883226820149248}]
I20260924 12:58:14.074179 31304 mvcc.cc:205] Tried to move back new op lower bound from 7332883226820149248 to 7332883226616573952. Current Snapshot: MvccSnapshot[applied={T|T < 7332883226820149248}]
I20260924 12:58:14.103488 30812 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:58:14.103914 30812 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:58:14.109031 30812 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 13a95d6c51a04d87a0bf8211b9e738a4: Sending DeleteTablet for 3 replicas of tablet 6e049053c125484cac385833ea507369
I20260924 12:58:14.111035 31071 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e049053c125484cac385833ea507369 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:14 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:56588
I20260924 12:58:14.111035 30937 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e049053c125484cac385833ea507369 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:14 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:49030
I20260924 12:58:14.111478 31205 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e049053c125484cac385833ea507369 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:14 UTC) from {username='kudu', principal='kudu/127.11.49.126@KRBTEST.COM'} at 127.0.0.1:38574
I20260924 12:58:14.118494 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 30874
I20260924 12:58:14.125794 31313 tablet_replica.cc:330] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: stopping tablet replica
I20260924 12:58:14.127249 31313 raft_consensus.cc:2229] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:58:14.129287 31313 raft_consensus.cc:2258] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:14.131672 31312 tablet_replica.cc:330] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38: stopping tablet replica
I20260924 12:58:14.132879 31312 raft_consensus.cc:2229] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:58:14.135047 31313 ts_tablet_manager.cc:1905] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:14.135878 31312 raft_consensus.cc:2258] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:14.139603 31314 tablet_replica.cc:330] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: stopping tablet replica
I20260924 12:58:14.140304 31314 raft_consensus.cc:2229] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:58:14.141875 31312 ts_tablet_manager.cc:1905] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:14.143616 31314 raft_consensus.cc:2258] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:14.145715 31313 ts_tablet_manager.cc:1918] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:14.146020 31313 log.cc:1196] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/6e049053c125484cac385833ea507369
I20260924 12:58:14.146873 31313 ts_tablet_manager.cc:1939] T 6e049053c125484cac385833ea507369 P cc5f5f55e1e0413c8554519da9ac010a: Deleting consensus metadata
I20260924 12:58:14.147243 31314 ts_tablet_manager.cc:1905] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:14.149770 30799 catalog_manager.cc:4841] TS cc5f5f55e1e0413c8554519da9ac010a (127.11.49.66:45125): tablet 6e049053c125484cac385833ea507369 (table test-table [id=52f4088564ff410cb337c2cde65a061c]) successfully deleted
I20260924 12:58:14.150269 31312 ts_tablet_manager.cc:1918] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:14.150491 31312 log.cc:1196] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/6e049053c125484cac385833ea507369
I20260924 12:58:14.151108 31312 ts_tablet_manager.cc:1939] T 6e049053c125484cac385833ea507369 P f76e4735ea244f0cb7181e7c8d811a38: Deleting consensus metadata
I20260924 12:58:14.155623 30797 catalog_manager.cc:4841] TS f76e4735ea244f0cb7181e7c8d811a38 (127.11.49.65:42075): tablet 6e049053c125484cac385833ea507369 (table test-table [id=52f4088564ff410cb337c2cde65a061c]) successfully deleted
Sep 24 12:58:14 dist-test-slave-m9hg krb5kdc[30768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.65@KRBTEST.COM
I20260924 12:58:14.157595 31314 ts_tablet_manager.cc:1918] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:14.158041 31314 log.cc:1196] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/6e049053c125484cac385833ea507369
I20260924 12:58:14.158612 31314 ts_tablet_manager.cc:1939] T 6e049053c125484cac385833ea507369 P d3efb0ec06a143f988630032ffcb84f1: Deleting consensus metadata
I20260924 12:58:14.161222 30798 catalog_manager.cc:4841] TS d3efb0ec06a143f988630032ffcb84f1 (127.11.49.67:38137): tablet 6e049053c125484cac385833ea507369 (table test-table [id=52f4088564ff410cb337c2cde65a061c]) successfully deleted
I20260924 12:58:14.167032 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:14.121592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49034 (local address 127.11.49.65:42075)
0924 12:58:14.121951 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:14.121965 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:14.132567 (+ 10602us) server_negotiation.cc:407] Connection header received
0924 12:58:14.133229 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:14.133236 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:14.133337 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:14.133422 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:14.135631 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:14.136901 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:14.140575 (+ 3674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:14.141372 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:14.141502 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:14.157911 (+ 16409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:14.157934 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:14.157956 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:14.158030 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:14.162803 (+ 4773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:14.163944 (+ 1141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:14.163955 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:14.163959 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:14.164159 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:14.164775 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:14.164781 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:14.164785 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:14.165357 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:14.165706 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:14.166237 (+ 531us) server_negotiation.cc:299] Negotiation successful
0924 12:58:14.166584 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260924 12:58:14.168026 30997 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:14.272315 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 30874
I20260924 12:58:14.294394 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 31008
Sep 24 12:58:14 dist-test-slave-m9hg krb5kdc[30768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.66@KRBTEST.COM
I20260924 12:58:14.315117 31287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:14.295476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56592 (local address 127.11.49.66:45125)
0924 12:58:14.295783 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:14.295792 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:14.295821 (+ 29us) server_negotiation.cc:407] Connection header received
0924 12:58:14.295911 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:14.295917 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:14.296017 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:14.296156 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:14.297815 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:14.299034 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:14.300800 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:14.301453 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:14.301605 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:14.306932 (+ 5327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:14.306953 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:14.306975 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:14.307034 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:14.311279 (+ 4245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:14.312402 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:14.312412 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:14.312415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:14.312683 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:14.313170 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:14.313175 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:14.313179 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:14.313715 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:14.314095 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:14.314412 (+ 317us) server_negotiation.cc:299] Negotiation successful
0924 12:58:14.314708 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260924 12:58:14.315930 31131 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:14.438747 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 31008
I20260924 12:58:14.460412 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 31142
Sep 24 12:58:14 dist-test-slave-m9hg krb5kdc[30768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.67@KRBTEST.COM
I20260924 12:58:14.484854 31288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:14.461538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38590 (local address 127.11.49.67:38137)
0924 12:58:14.461788 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:14.461794 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:14.461880 (+ 86us) server_negotiation.cc:407] Connection header received
0924 12:58:14.462181 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:14.462186 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:14.462311 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:14.462453 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:14.464490 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:14.465682 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:14.467352 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:14.468123 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:14.468347 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:14.476028 (+ 7681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:14.476054 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:14.476076 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:14.476142 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:14.480701 (+ 4559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:14.481963 (+ 1262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:14.481973 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:14.481977 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:14.482185 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:14.482730 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:14.482736 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:14.482739 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:14.483268 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:14.483645 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:14.484088 (+ 443us) server_negotiation.cc:299] Negotiation successful
0924 12:58:14.484409 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260924 12:58:14.485863 31265 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:14.634109 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 31142
I20260924 12:58:14.658483 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 30781
I20260924 12:58:14.659919 30843 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:14.778054 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 30781
2026-09-24T12:58:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5099 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-24T12:58:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:14Z Disabled control of system clock
I20260924 12:58:14.866524 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:36899
--webserver_interface=127.11.49.126
--webserver_port=0
--builtin_ntp_servers=127.11.49.84:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:36899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 12:58:15.306156 31323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:15.306592 31323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:15.306798 31323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:15.315475 31323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:15.315653 31323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:15.315793 31323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:15.315913 31323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:15.315985 31323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:15.327878 31323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:36899
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:36899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:15.329818 31323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:15.332223 31323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:15.347447 31331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:15.347580 31328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:15.347612 31329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:15.349406 31323 server_base.cc:1034] running on GCE node
I20260924 12:58:15.350654 31323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:15.352873 31323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:15.354172 31323 hybrid_clock.cc:648] HybridClock initialized: now 1790254695354120 us; error 63 us; skew 500 ppm
I20260924 12:58:15.354672 31323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:58:15.357738 31323 webserver.cc:460] Webserver started at http://127.11.49.126:37207/ using document root <none> and password file <none>
I20260924 12:58:15.358574 31323 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:15.358723 31323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:15.359092 31323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:15.362560 31323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "759aef0603a6489dabefeeef6ba06c1f"
format_stamp: "Formatted at 2026-09-24 12:58:15 on dist-test-slave-m9hg"
server_key: "c0ee68342c8b0ee439de32da10db1e13"
server_key_iv: "cc8a57a6491db733a1bc607fb5319bb6"
server_key_version: "encryptionkey@0"
I20260924 12:58:15.363498 31323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "759aef0603a6489dabefeeef6ba06c1f"
format_stamp: "Formatted at 2026-09-24 12:58:15 on dist-test-slave-m9hg"
server_key: "c0ee68342c8b0ee439de32da10db1e13"
server_key_iv: "cc8a57a6491db733a1bc607fb5319bb6"
server_key_version: "encryptionkey@0"
I20260924 12:58:15.369913 31323 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260924 12:58:15.374217 31337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:15.376140 31323 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:58:15.376466 31323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "759aef0603a6489dabefeeef6ba06c1f"
format_stamp: "Formatted at 2026-09-24 12:58:15 on dist-test-slave-m9hg"
server_key: "c0ee68342c8b0ee439de32da10db1e13"
server_key_iv: "cc8a57a6491db733a1bc607fb5319bb6"
server_key_version: "encryptionkey@0"
I20260924 12:58:15.376730 31323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:15.407600 31323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:15.408674 31323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:15.408986 31323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:15.433101 31323 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:36899
I20260924 12:58:15.433166 31388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:36899 every 8 connection(s)
I20260924 12:58:15.435098 31323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:15.440485 31389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:15.440562 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 31323
I20260924 12:58:15.440742 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:15.441361 11461 external_mini_cluster.cc:1428] Setting key eac4421e06a124ce13f418f03af13439
I20260924 12:58:15.457472 31389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f: Bootstrap starting.
I20260924 12:58:15.458216 31392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:15.443936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36086 (local address 127.11.49.126:36899)
0924 12:58:15.445442 (+ 1506us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:15.445456 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:15.445510 (+ 54us) server_negotiation.cc:407] Connection header received
0924 12:58:15.448200 (+ 2690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:15.448229 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:15.448955 (+ 726us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:15.449416 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:15.450049 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:15.451372 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:15.452894 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:15.453688 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:15.453942 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:15.455396 (+ 1454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:15.455404 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:15.455421 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:15.456072 (+ 651us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:15.456163 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:15.456188 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:15.456372 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:15.456659 (+ 287us) server_negotiation.cc:299] Negotiation successful
0924 12:58:15.457021 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":886,"thread_start_us":511,"threads_started":1}
I20260924 12:58:15.462267 31389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:15.463835 31389 log.cc:824] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:15.468245 31389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f: No bootstrap required, opened a new log
I20260924 12:58:15.479066 31389 raft_consensus.cc:348] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759aef0603a6489dabefeeef6ba06c1f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36899 } }
I20260924 12:58:15.479595 31389 raft_consensus.cc:374] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:15.479681 31389 raft_consensus.cc:729] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 759aef0603a6489dabefeeef6ba06c1f, State: Initialized, Role: FOLLOWER
I20260924 12:58:15.480506 31389 consensus_queue.cc:260] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759aef0603a6489dabefeeef6ba06c1f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36899 } }
I20260924 12:58:15.480850 31389 raft_consensus.cc:388] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:15.481014 31389 raft_consensus.cc:482] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:15.481237 31389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:15.484242 31389 raft_consensus.cc:504] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759aef0603a6489dabefeeef6ba06c1f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36899 } }
I20260924 12:58:15.485105 31389 leader_election.cc:302] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 759aef0603a6489dabefeeef6ba06c1f; no voters:
I20260924 12:58:15.486003 31389 leader_election.cc:288] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:15.486152 31394 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:15.487251 31394 raft_consensus.cc:686] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [term 1 LEADER]: Becoming Leader. State: Replica: 759aef0603a6489dabefeeef6ba06c1f, State: Running, Role: LEADER
I20260924 12:58:15.488026 31394 consensus_queue.cc:237] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759aef0603a6489dabefeeef6ba06c1f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36899 } }
I20260924 12:58:15.489346 31389 sys_catalog.cc:564] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:15.491950 31395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "759aef0603a6489dabefeeef6ba06c1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759aef0603a6489dabefeeef6ba06c1f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36899 } } }
I20260924 12:58:15.492713 31395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:15.491991 31396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 759aef0603a6489dabefeeef6ba06c1f. Latest consensus state: current_term: 1 leader_uuid: "759aef0603a6489dabefeeef6ba06c1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759aef0603a6489dabefeeef6ba06c1f" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36899 } } }
I20260924 12:58:15.494117 31396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:15.495126 31401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:15.502274 31401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:15.513960 31401 catalog_manager.cc:1347] Generated new cluster ID: e65632c2dbea4e9eadea4f20261675f7
I20260924 12:58:15.514142 31401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:15.525411 31401 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:15.527129 31401 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:15.544261 31401 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f: Generated new TSK 0
I20260924 12:58:15.545635 31401 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:15.559970 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.65:0
--local_ip_for_outbound_sockets=127.11.49.65
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:36899
--builtin_ntp_servers=127.11.49.84:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 12:58:15.954239 31413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:15.954577 31413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:15.954716 31413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:15.962805 31413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:15.962954 31413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:15.963071 31413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.65
I20260924 12:58:15.973081 31413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.49.65
--webserver_port=0
--tserver_master_addrs=127.11.49.126:36899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.65
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:15.974471 31413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:15.976434 31413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:15.993796 31421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:15.994184 31419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:15.994167 31418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:15.998529 31413 server_base.cc:1034] running on GCE node
I20260924 12:58:15.999552 31413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:16.001261 31413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:16.002584 31413 hybrid_clock.cc:648] HybridClock initialized: now 1790254696002506 us; error 62 us; skew 500 ppm
I20260924 12:58:16.003093 31413 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:58:16.006534 31413 webserver.cc:460] Webserver started at http://127.11.49.65:42067/ using document root <none> and password file <none>
I20260924 12:58:16.007629 31413 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:16.007783 31413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:16.008204 31413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:16.012096 31413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/data/instance:
uuid: "d05bb2157ff348d4b64574a3bb0ae905"
format_stamp: "Formatted at 2026-09-24 12:58:16 on dist-test-slave-m9hg"
server_key: "2e5d580bab2f3cce90580f8041710830"
server_key_iv: "5d2e2fd9eacb437870b7f4122b96f74c"
server_key_version: "encryptionkey@0"
I20260924 12:58:16.013316 31413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance:
uuid: "d05bb2157ff348d4b64574a3bb0ae905"
format_stamp: "Formatted at 2026-09-24 12:58:16 on dist-test-slave-m9hg"
server_key: "2e5d580bab2f3cce90580f8041710830"
server_key_iv: "5d2e2fd9eacb437870b7f4122b96f74c"
server_key_version: "encryptionkey@0"
I20260924 12:58:16.020606 31413 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260924 12:58:16.025722 31427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:16.027866 31413 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260924 12:58:16.028223 31413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/wal
uuid: "d05bb2157ff348d4b64574a3bb0ae905"
format_stamp: "Formatted at 2026-09-24 12:58:16 on dist-test-slave-m9hg"
server_key: "2e5d580bab2f3cce90580f8041710830"
server_key_iv: "5d2e2fd9eacb437870b7f4122b96f74c"
server_key_version: "encryptionkey@0"
I20260924 12:58:16.028607 31413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:16.064165 31413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:16.065629 31413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:16.066036 31413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:16.067641 31413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:16.069622 31413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:16.069736 31413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:16.069885 31413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:16.069971 31413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:16.115346 31413 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.65:39797
I20260924 12:58:16.115495 31539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.65:39797 every 8 connection(s)
I20260924 12:58:16.117830 31413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/data/info.pb
I20260924 12:58:16.127560 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 31413
I20260924 12:58:16.127772 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/wal/instance
I20260924 12:58:16.128443 11461 external_mini_cluster.cc:1428] Setting key 04777221810516e4ba7225aa6b5b221a
I20260924 12:58:16.132175 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.66:0
--local_ip_for_outbound_sockets=127.11.49.66
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:36899
--builtin_ntp_servers=127.11.49.84:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260924 12:58:16.136240 31542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:16.121880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.65:47029 (local address 127.11.49.126:36899)
0924 12:58:16.122507 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:16.122516 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:16.124432 (+ 1916us) server_negotiation.cc:407] Connection header received
0924 12:58:16.126576 (+ 2144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:16.126583 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:16.126687 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:16.126837 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:16.128349 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:16.129447 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:16.131917 (+ 2470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:16.132567 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:16.132695 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:16.135249 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:16.135255 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:16.135259 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:16.135283 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:16.135333 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:16.135346 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:16.135439 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:16.135871 (+ 432us) server_negotiation.cc:299] Negotiation successful
0924 12:58:16.135976 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":271,"threads_started":1}
I20260924 12:58:16.138414 31543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:16.122760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:36899 (local address 127.11.49.65:47029)
0924 12:58:16.124155 (+ 1395us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:16.124211 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:16.126197 (+ 1986us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:16.127142 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:16.127152 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:16.127259 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:16.128055 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:16.128077 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:16.129724 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:16.129730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:16.131606 (+ 1876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:16.131634 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:16.132881 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:16.132894 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:16.133493 (+ 599us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:16.134700 (+ 1207us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:58:16.134707 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:16.134788 (+ 81us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:58:16.134958 (+ 170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:16.135486 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:16.135503 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:16.135531 (+ 28us) client_negotiation.cc:769] Sending connection context
0924 12:58:16.135807 (+ 276us) client_negotiation.cc:240] Negotiation successful
0924 12:58:16.136507 (+ 700us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"thread_start_us":438,"threads_started":1}
I20260924 12:58:16.140801 31540 heartbeater.cc:347] Connected to a master server at 127.11.49.126:36899
I20260924 12:58:16.141234 31540 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:16.142153 31540 heartbeater.cc:511] Master 127.11.49.126:36899 requested a full tablet report, sending...
I20260924 12:58:16.144754 31354 ts_manager.cc:194] Registered new tserver with Master: d05bb2157ff348d4b64574a3bb0ae905 (127.11.49.65:39797)
I20260924 12:58:16.147083 31354 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.65:47029
W20260924 12:58:16.496122 31544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:16.496541 31544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:16.496637 31544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:16.504115 31544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:16.504233 31544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:16.504434 31544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.66
I20260924 12:58:16.514364 31544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.49.66
--webserver_port=0
--tserver_master_addrs=127.11.49.126:36899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.66
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:16.515643 31544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:16.517432 31544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:16.537725 31550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:16.538062 31549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:16.538062 31552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:16.539402 31544 server_base.cc:1034] running on GCE node
I20260924 12:58:16.540139 31544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:16.541452 31544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:16.542708 31544 hybrid_clock.cc:648] HybridClock initialized: now 1790254696542649 us; error 57 us; skew 500 ppm
I20260924 12:58:16.543109 31544 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:58:16.546356 31544 webserver.cc:460] Webserver started at http://127.11.49.66:41285/ using document root <none> and password file <none>
I20260924 12:58:16.547108 31544 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:16.547206 31544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:16.547493 31544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:16.550616 31544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/data/instance:
uuid: "a423ea952bdf497ab9d96b5150346282"
format_stamp: "Formatted at 2026-09-24 12:58:16 on dist-test-slave-m9hg"
server_key: "7af71a46d400ec119af91e3282252463"
server_key_iv: "ab71b38a008a582619da7336fbad47fa"
server_key_version: "encryptionkey@0"
I20260924 12:58:16.551445 31544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance:
uuid: "a423ea952bdf497ab9d96b5150346282"
format_stamp: "Formatted at 2026-09-24 12:58:16 on dist-test-slave-m9hg"
server_key: "7af71a46d400ec119af91e3282252463"
server_key_iv: "ab71b38a008a582619da7336fbad47fa"
server_key_version: "encryptionkey@0"
I20260924 12:58:16.557600 31544 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260924 12:58:16.561899 31558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:16.563840 31544 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:58:16.564105 31544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/wal
uuid: "a423ea952bdf497ab9d96b5150346282"
format_stamp: "Formatted at 2026-09-24 12:58:16 on dist-test-slave-m9hg"
server_key: "7af71a46d400ec119af91e3282252463"
server_key_iv: "ab71b38a008a582619da7336fbad47fa"
server_key_version: "encryptionkey@0"
I20260924 12:58:16.564452 31544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:16.580700 31544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:16.581689 31544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:16.582027 31544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:16.583233 31544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:16.585017 31544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:16.585160 31544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:16.585309 31544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:16.585403 31544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:16.629127 31544 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.66:38489
I20260924 12:58:16.629194 31670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.66:38489 every 8 connection(s)
I20260924 12:58:16.631140 31544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/data/info.pb
I20260924 12:58:16.631980 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 31544
I20260924 12:58:16.632215 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/wal/instance
I20260924 12:58:16.632877 11461 external_mini_cluster.cc:1428] Setting key 50dd306cfe2ac63bb0d33418a80f0e49
I20260924 12:58:16.636831 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.49.67:0
--local_ip_for_outbound_sockets=127.11.49.67
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:36899
--builtin_ntp_servers=127.11.49.84:39151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260924 12:58:16.648247 31542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:16.635135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.66:39161 (local address 127.11.49.126:36899)
0924 12:58:16.635332 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:16.635340 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:16.637268 (+ 1928us) server_negotiation.cc:407] Connection header received
0924 12:58:16.639205 (+ 1937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:16.639214 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:16.639345 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:16.639567 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:16.641017 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:16.642281 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:16.644143 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:16.644996 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:16.645204 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:16.647046 (+ 1842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:16.647056 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:16.647064 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:16.647100 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:16.647163 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:16.647185 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:16.647303 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:16.647605 (+ 302us) server_negotiation.cc:299] Negotiation successful
0924 12:58:16.647766 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260924 12:58:16.649597 31673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:16.635794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:36899 (local address 127.11.49.66:39161)
0924 12:58:16.637074 (+ 1280us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:16.637123 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:16.638842 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:16.639990 (+ 1148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:16.639999 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:16.640097 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:16.640779 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:16.640796 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:16.642507 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:16.642511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:16.643924 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:16.643939 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:16.645314 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:16.645321 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:16.645595 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:16.646615 (+ 1020us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:58:16.646618 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:16.646665 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:58:16.646764 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:16.647340 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:16.647349 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:16.647356 (+ 7us) client_negotiation.cc:769] Sending connection context
0924 12:58:16.647549 (+ 193us) client_negotiation.cc:240] Negotiation successful
0924 12:58:16.647964 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":455,"threads_started":1}
I20260924 12:58:16.651643 31671 heartbeater.cc:347] Connected to a master server at 127.11.49.126:36899
I20260924 12:58:16.652244 31671 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:16.653553 31671 heartbeater.cc:511] Master 127.11.49.126:36899 requested a full tablet report, sending...
I20260924 12:58:16.656368 31354 ts_manager.cc:194] Registered new tserver with Master: a423ea952bdf497ab9d96b5150346282 (127.11.49.66:38489)
I20260924 12:58:16.657703 31354 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.66:39161
W20260924 12:58:16.993160 31674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:16.993518 31674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:16.993680 31674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:17.001497 31674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:17.001658 31674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:17.001839 31674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.49.67
I20260924 12:58:17.011437 31674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:39151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.49.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.49.67
--webserver_port=0
--tserver_master_addrs=127.11.49.126:36899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.49.67
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:17.012813 31674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:17.014580 31674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:17.029469 31682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:17.029434 31680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:17.030048 31679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:17.031008 31674 server_base.cc:1034] running on GCE node
I20260924 12:58:17.031896 31674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:17.033069 31674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:17.034578 31674 hybrid_clock.cc:648] HybridClock initialized: now 1790254697034475 us; error 72 us; skew 500 ppm
I20260924 12:58:17.034950 31674 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 12:58:17.037734 31674 webserver.cc:460] Webserver started at http://127.11.49.67:40581/ using document root <none> and password file <none>
I20260924 12:58:17.038488 31674 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:17.038580 31674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:17.038841 31674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:17.041927 31674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/data/instance:
uuid: "efd9468d7d29480aad572fa9bd310e9e"
format_stamp: "Formatted at 2026-09-24 12:58:17 on dist-test-slave-m9hg"
server_key: "9d150860f679e64c0e107272c28d5ac6"
server_key_iv: "7e35505fbddd7cbfe631acb9ceefee1d"
server_key_version: "encryptionkey@0"
I20260924 12:58:17.042707 31674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance:
uuid: "efd9468d7d29480aad572fa9bd310e9e"
format_stamp: "Formatted at 2026-09-24 12:58:17 on dist-test-slave-m9hg"
server_key: "9d150860f679e64c0e107272c28d5ac6"
server_key_iv: "7e35505fbddd7cbfe631acb9ceefee1d"
server_key_version: "encryptionkey@0"
I20260924 12:58:17.048496 31674 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260924 12:58:17.053081 31688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:17.054721 31674 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:58:17.054929 31674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/wal
uuid: "efd9468d7d29480aad572fa9bd310e9e"
format_stamp: "Formatted at 2026-09-24 12:58:17 on dist-test-slave-m9hg"
server_key: "9d150860f679e64c0e107272c28d5ac6"
server_key_iv: "7e35505fbddd7cbfe631acb9ceefee1d"
server_key_version: "encryptionkey@0"
I20260924 12:58:17.055128 31674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:17.080804 31674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:17.081750 31674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:17.082077 31674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:17.083192 31674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 12:58:17.084887 31674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 12:58:17.084982 31674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:17.085068 31674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 12:58:17.085120 31674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:17.128575 31674 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.67:35271
I20260924 12:58:17.128669 31800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.67:35271 every 8 connection(s)
I20260924 12:58:17.129931 31674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/data/info.pb
I20260924 12:58:17.135514 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 31674
I20260924 12:58:17.135769 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/wal/instance
I20260924 12:58:17.136538 11461 external_mini_cluster.cc:1428] Setting key b73f224adc53cc66243a5858e8a770ec
I20260924 12:58:17.147634 31542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.133135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:40639 (local address 127.11.49.126:36899)
0924 12:58:17.133392 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:17.133397 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:17.135600 (+ 2203us) server_negotiation.cc:407] Connection header received
0924 12:58:17.138781 (+ 3181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:17.138786 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:17.138930 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:17.139078 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:17.140853 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.141732 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.143917 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.144492 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.144617 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.146653 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:17.146659 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:17.146663 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:17.146688 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:17.146728 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:17.146740 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:17.146835 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:17.147183 (+ 348us) server_negotiation.cc:299] Negotiation successful
0924 12:58:17.147343 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260924 12:58:17.149194 31803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.133805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:36899 (local address 127.11.49.67:40639)
0924 12:58:17.135316 (+ 1511us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:17.135381 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:17.138307 (+ 2926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:17.139504 (+ 1197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:17.139516 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:17.139659 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:58:17.140609 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.140635 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.142003 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.142008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.143714 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.143733 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.144802 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.144811 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.145156 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.146222 (+ 1066us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 12:58:17.146225 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:58:17.146281 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 12:58:17.146402 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:58:17.146876 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:58:17.146885 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:58:17.146894 (+ 9us) client_negotiation.cc:769] Sending connection context
0924 12:58:17.147120 (+ 226us) client_negotiation.cc:240] Negotiation successful
0924 12:58:17.147594 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"thread_start_us":472,"threads_started":1}
I20260924 12:58:17.151145 31801 heartbeater.cc:347] Connected to a master server at 127.11.49.126:36899
I20260924 12:58:17.151590 31801 heartbeater.cc:464] Registering TS with master...
I20260924 12:58:17.152107 31540 heartbeater.cc:503] Master 127.11.49.126:36899 was elected leader, sending a full tablet report...
I20260924 12:58:17.152877 31801 heartbeater.cc:511] Master 127.11.49.126:36899 requested a full tablet report, sending...
I20260924 12:58:17.154706 31354 ts_manager.cc:194] Registered new tserver with Master: efd9468d7d29480aad572fa9bd310e9e (127.11.49.67:35271)
I20260924 12:58:17.155583 31354 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.49.67:40639
I20260924 12:58:17.167548 11461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 12:58:17.180743 31542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.173550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54532 (local address 127.11.49.126:36899)
0924 12:58:17.173828 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:17.173853 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:17.174390 (+ 537us) server_negotiation.cc:407] Connection header received
0924 12:58:17.174602 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:17.174607 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:17.174683 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:17.174838 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:17.175509 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.176354 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.177951 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.178359 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.178470 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.179863 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:17.179868 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:17.179871 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:17.179892 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:17.179927 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:17.179940 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:17.180026 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:17.180337 (+ 311us) server_negotiation.cc:299] Negotiation successful
0924 12:58:17.180458 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260924 12:58:17.186017 31354 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54532:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 12:58:17.196056 31354 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 12:58:17.238056 31817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.213442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:39797 (local address 127.0.0.1:34194)
0924 12:58:17.225323 (+ 11881us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:17.225349 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:17.225529 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:17.227529 (+ 2000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:17.227540 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:17.227576 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:17.228008 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.228023 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.230444 (+ 2421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.230453 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.233273 (+ 2820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.233295 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.236755 (+ 3460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.236766 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.237066 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.237148 (+ 82us) client_negotiation.cc:769] Sending connection context
0924 12:58:17.237343 (+ 195us) client_negotiation.cc:240] Negotiation successful
0924 12:58:17.237603 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11683,"thread_start_us":21394,"threads_started":1}
I20260924 12:58:17.239430 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.213701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34194 (local address 127.11.49.65:39797)
0924 12:58:17.224686 (+ 10985us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:17.224710 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:17.225692 (+ 982us) server_negotiation.cc:407] Connection header received
0924 12:58:17.225831 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:17.225842 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:17.226200 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:17.226455 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:17.228230 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.230244 (+ 2014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.233540 (+ 3296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.236015 (+ 2475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.236203 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.236595 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:17.238748 (+ 2153us) server_negotiation.cc:299] Negotiation successful
0924 12:58:17.238978 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10483,"thread_start_us":10569,"threads_started":1}
I20260924 12:58:17.244020 31475 tablet_service.cc:1467] Processing CreateTablet for tablet e8910af1ede049a186bb4601fcf60425 (DEFAULT_TABLE table=test-table [id=acaeacbe10764789bd51d5e734ea4d58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:17.244865 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.214330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.67:35271 (local address 127.0.0.1:40672)
0924 12:58:17.227167 (+ 12837us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:17.227192 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:17.227337 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:17.234600 (+ 7263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:17.234607 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:17.234647 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:17.235288 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.235312 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.239745 (+ 4433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.239752 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.241719 (+ 1967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.241737 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.243881 (+ 2144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.243887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.244089 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.244131 (+ 42us) client_negotiation.cc:769] Sending connection context
0924 12:58:17.244212 (+ 81us) client_negotiation.cc:240] Negotiation successful
0924 12:58:17.244420 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12680,"mutex_wait_us":82,"thread_start_us":10581,"threads_started":1}
I20260924 12:58:17.245847 31475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8910af1ede049a186bb4601fcf60425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:17.247495 31813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.212714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:38489 (local address 127.0.0.1:54980)
0924 12:58:17.219503 (+ 6789us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:17.219580 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:17.219862 (+ 282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:17.236817 (+ 16955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:17.236822 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:17.236858 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:17.237423 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.237437 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.239801 (+ 2364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.239808 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.243592 (+ 3784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.243610 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.246549 (+ 2939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.246555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.246744 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.246797 (+ 53us) client_negotiation.cc:769] Sending connection context
0924 12:58:17.246890 (+ 93us) client_negotiation.cc:240] Negotiation successful
0924 12:58:17.247047 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6373,"mutex_wait_us":98,"thread_start_us":390,"threads_started":1}
I20260924 12:58:17.247962 31818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.215105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40672 (local address 127.11.49.67:35271)
0924 12:58:17.233167 (+ 18062us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:17.233183 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:17.233248 (+ 65us) server_negotiation.cc:407] Connection header received
0924 12:58:17.233422 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:17.233437 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:17.233888 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:17.235417 (+ 1529us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:17.235820 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.239521 (+ 3701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.241941 (+ 2420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.243620 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.246874 (+ 3254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.247190 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:17.247277 (+ 87us) server_negotiation.cc:299] Negotiation successful
0924 12:58:17.247510 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17739,"thread_start_us":19085,"threads_started":1}
I20260924 12:58:17.248883 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.212999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54980 (local address 127.11.49.66:38489)
0924 12:58:17.235661 (+ 22662us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:17.235689 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:17.235730 (+ 41us) server_negotiation.cc:407] Connection header received
0924 12:58:17.235866 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:17.235877 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:17.236234 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:17.236523 (+ 289us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:17.237646 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.239487 (+ 1841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.243869 (+ 4382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.245888 (+ 2019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.246100 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.246409 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:17.247769 (+ 1360us) server_negotiation.cc:299] Negotiation successful
0924 12:58:17.247982 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21551,"thread_start_us":21412,"threads_started":1}
I20260924 12:58:17.252461 31736 tablet_service.cc:1467] Processing CreateTablet for tablet e8910af1ede049a186bb4601fcf60425 (DEFAULT_TABLE table=test-table [id=acaeacbe10764789bd51d5e734ea4d58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:17.254092 31736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8910af1ede049a186bb4601fcf60425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:17.253647 31606 tablet_service.cc:1467] Processing CreateTablet for tablet e8910af1ede049a186bb4601fcf60425 (DEFAULT_TABLE table=test-table [id=acaeacbe10764789bd51d5e734ea4d58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 12:58:17.255774 31606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8910af1ede049a186bb4601fcf60425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:17.272419 31819 tablet_bootstrap.cc:492] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: Bootstrap starting.
I20260924 12:58:17.275045 31820 tablet_bootstrap.cc:492] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: Bootstrap starting.
I20260924 12:58:17.276597 31819 tablet_bootstrap.cc:654] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:17.278149 31819 log.cc:824] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:17.284727 31819 tablet_bootstrap.cc:492] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: No bootstrap required, opened a new log
I20260924 12:58:17.285115 31819 ts_tablet_manager.cc:1397] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260924 12:58:17.286000 31820 tablet_bootstrap.cc:654] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:17.287986 31820 log.cc:824] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:17.292423 31820 tablet_bootstrap.cc:492] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: No bootstrap required, opened a new log
I20260924 12:58:17.292757 31820 ts_tablet_manager.cc:1397] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.000s
I20260924 12:58:17.293928 31822 tablet_bootstrap.cc:492] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: Bootstrap starting.
I20260924 12:58:17.300891 31822 tablet_bootstrap.cc:654] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:17.303598 31819 raft_consensus.cc:348] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423ea952bdf497ab9d96b5150346282" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38489 } } peers { permanent_uuid: "efd9468d7d29480aad572fa9bd310e9e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 35271 } } peers { permanent_uuid: "d05bb2157ff348d4b64574a3bb0ae905" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39797 } }
I20260924 12:58:17.304569 31819 raft_consensus.cc:374] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:17.304775 31819 raft_consensus.cc:729] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d05bb2157ff348d4b64574a3bb0ae905, State: Initialized, Role: FOLLOWER
I20260924 12:58:17.305246 31822 log.cc:824] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:17.305866 31819 consensus_queue.cc:260] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423ea952bdf497ab9d96b5150346282" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38489 } } peers { permanent_uuid: "efd9468d7d29480aad572fa9bd310e9e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 35271 } } peers { permanent_uuid: "d05bb2157ff348d4b64574a3bb0ae905" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39797 } }
I20260924 12:58:17.305831 31820 raft_consensus.cc:348] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423ea952bdf497ab9d96b5150346282" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38489 } } peers { permanent_uuid: "efd9468d7d29480aad572fa9bd310e9e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 35271 } } peers { permanent_uuid: "d05bb2157ff348d4b64574a3bb0ae905" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39797 } }
I20260924 12:58:17.306520 31820 raft_consensus.cc:374] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:17.306650 31820 raft_consensus.cc:729] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a423ea952bdf497ab9d96b5150346282, State: Initialized, Role: FOLLOWER
I20260924 12:58:17.307515 31820 consensus_queue.cc:260] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423ea952bdf497ab9d96b5150346282" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38489 } } peers { permanent_uuid: "efd9468d7d29480aad572fa9bd310e9e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 35271 } } peers { permanent_uuid: "d05bb2157ff348d4b64574a3bb0ae905" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39797 } }
I20260924 12:58:17.309682 31822 tablet_bootstrap.cc:492] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: No bootstrap required, opened a new log
I20260924 12:58:17.310081 31822 ts_tablet_manager.cc:1397] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.000s
I20260924 12:58:17.315871 31820 ts_tablet_manager.cc:1428] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: Time spent starting tablet: real 0.023s user 0.017s sys 0.004s
I20260924 12:58:17.316315 31671 heartbeater.cc:503] Master 127.11.49.126:36899 was elected leader, sending a full tablet report...
I20260924 12:58:17.318303 31819 ts_tablet_manager.cc:1428] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: Time spent starting tablet: real 0.033s user 0.013s sys 0.015s
I20260924 12:58:17.324095 31822 raft_consensus.cc:348] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423ea952bdf497ab9d96b5150346282" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38489 } } peers { permanent_uuid: "efd9468d7d29480aad572fa9bd310e9e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 35271 } } peers { permanent_uuid: "d05bb2157ff348d4b64574a3bb0ae905" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39797 } }
I20260924 12:58:17.324769 31822 raft_consensus.cc:374] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:17.324880 31822 raft_consensus.cc:729] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd9468d7d29480aad572fa9bd310e9e, State: Initialized, Role: FOLLOWER
I20260924 12:58:17.325759 31822 consensus_queue.cc:260] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423ea952bdf497ab9d96b5150346282" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38489 } } peers { permanent_uuid: "efd9468d7d29480aad572fa9bd310e9e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 35271 } } peers { permanent_uuid: "d05bb2157ff348d4b64574a3bb0ae905" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39797 } }
I20260924 12:58:17.327267 31801 heartbeater.cc:503] Master 127.11.49.126:36899 was elected leader, sending a full tablet report...
I20260924 12:58:17.327872 31822 ts_tablet_manager.cc:1428] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: Time spent starting tablet: real 0.018s user 0.012s sys 0.004s
W20260924 12:58:17.371306 31541 tablet.cc:2369] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:58:17.381989 31802 tablet.cc:2369] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:58:17.383898 31672 tablet.cc:2369] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:58:17.560823 31827 raft_consensus.cc:482] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 12:58:17.561337 31827 raft_consensus.cc:504] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423ea952bdf497ab9d96b5150346282" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38489 } } peers { permanent_uuid: "efd9468d7d29480aad572fa9bd310e9e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 35271 } } peers { permanent_uuid: "d05bb2157ff348d4b64574a3bb0ae905" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39797 } }
I20260924 12:58:17.563452 31827 leader_election.cc:288] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a423ea952bdf497ab9d96b5150346282 (127.11.49.66:38489), d05bb2157ff348d4b64574a3bb0ae905 (127.11.49.65:39797)
I20260924 12:58:17.571734 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.564469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:47047 (local address 127.11.49.66:38489)
0924 12:58:17.564701 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:17.564710 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:17.565351 (+ 641us) server_negotiation.cc:407] Connection header received
0924 12:58:17.565622 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:17.565627 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:17.565718 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:17.565830 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:17.566464 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.567245 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.569609 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.570535 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.570723 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.570790 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:17.571273 (+ 483us) server_negotiation.cc:299] Negotiation successful
0924 12:58:17.571429 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260924 12:58:17.571887 31828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.563980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.66:38489 (local address 127.11.49.67:47047)
0924 12:58:17.565183 (+ 1203us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:17.565202 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:17.565440 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:17.565861 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:17.565866 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:17.565896 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:17.566272 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.566283 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.567432 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.567440 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.569400 (+ 1960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.569423 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.570815 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.570822 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.571025 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.571063 (+ 38us) client_negotiation.cc:769] Sending connection context
0924 12:58:17.571184 (+ 121us) client_negotiation.cc:240] Negotiation successful
0924 12:58:17.571385 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1048,"mutex_wait_us":54,"thread_start_us":809,"threads_started":1}
I20260924 12:58:17.572031 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.564623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.49.67:35623 (local address 127.11.49.65:39797)
0924 12:58:17.564890 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:17.564896 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:17.564914 (+ 18us) server_negotiation.cc:407] Connection header received
0924 12:58:17.564994 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:17.564998 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:17.565078 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:17.565199 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 12:58:17.565949 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.566854 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.569593 (+ 2739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.570792 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.570989 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.571070 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:17.571581 (+ 511us) server_negotiation.cc:299] Negotiation successful
0924 12:58:17.571757 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260924 12:58:17.572355 31803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.563932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.65:39797 (local address 127.11.49.67:35623)
0924 12:58:17.564323 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0924 12:58:17.564350 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:58:17.564562 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:58:17.565263 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:58:17.565268 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:58:17.565297 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 12:58:17.565698 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.565715 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.567029 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.567034 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.569277 (+ 2243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:58:17.569312 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.571046 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.571051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:58:17.571361 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.571402 (+ 41us) client_negotiation.cc:769] Sending connection context
0924 12:58:17.571521 (+ 119us) client_negotiation.cc:240] Negotiation successful
0924 12:58:17.571691 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":141,"spinlock_wait_cycles":27008}
I20260924 12:58:17.573241 31626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8910af1ede049a186bb4601fcf60425" candidate_uuid: "efd9468d7d29480aad572fa9bd310e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423ea952bdf497ab9d96b5150346282" is_pre_election: true
I20260924 12:58:17.573526 31495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8910af1ede049a186bb4601fcf60425" candidate_uuid: "efd9468d7d29480aad572fa9bd310e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d05bb2157ff348d4b64574a3bb0ae905" is_pre_election: true
I20260924 12:58:17.573976 31626 raft_consensus.cc:2454] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd9468d7d29480aad572fa9bd310e9e in term 0.
I20260924 12:58:17.574149 31495 raft_consensus.cc:2454] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd9468d7d29480aad572fa9bd310e9e in term 0.
I20260924 12:58:17.574906 31692 leader_election.cc:302] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: a423ea952bdf497ab9d96b5150346282, d05bb2157ff348d4b64574a3bb0ae905, efd9468d7d29480aad572fa9bd310e9e; no voters:
I20260924 12:58:17.575410 31827 raft_consensus.cc:2781] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 12:58:17.575587 31827 raft_consensus.cc:482] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 12:58:17.575716 31827 raft_consensus.cc:3037] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:17.578418 31827 raft_consensus.cc:504] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423ea952bdf497ab9d96b5150346282" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38489 } } peers { permanent_uuid: "efd9468d7d29480aad572fa9bd310e9e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 35271 } } peers { permanent_uuid: "d05bb2157ff348d4b64574a3bb0ae905" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39797 } }
I20260924 12:58:17.579272 31827 leader_election.cc:288] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [CANDIDATE]: Term 1 election: Requested vote from peers a423ea952bdf497ab9d96b5150346282 (127.11.49.66:38489), d05bb2157ff348d4b64574a3bb0ae905 (127.11.49.65:39797)
I20260924 12:58:17.579975 31626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8910af1ede049a186bb4601fcf60425" candidate_uuid: "efd9468d7d29480aad572fa9bd310e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a423ea952bdf497ab9d96b5150346282"
I20260924 12:58:17.580042 31495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8910af1ede049a186bb4601fcf60425" candidate_uuid: "efd9468d7d29480aad572fa9bd310e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d05bb2157ff348d4b64574a3bb0ae905"
I20260924 12:58:17.580333 31626 raft_consensus.cc:3037] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:17.580376 31495 raft_consensus.cc:3037] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:17.583489 31626 raft_consensus.cc:2454] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd9468d7d29480aad572fa9bd310e9e in term 1.
I20260924 12:58:17.583940 31495 raft_consensus.cc:2454] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd9468d7d29480aad572fa9bd310e9e in term 1.
I20260924 12:58:17.584054 31692 leader_election.cc:302] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a423ea952bdf497ab9d96b5150346282, efd9468d7d29480aad572fa9bd310e9e; no voters:
I20260924 12:58:17.584515 31827 raft_consensus.cc:2781] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:17.585290 31827 raft_consensus.cc:686] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 1 LEADER]: Becoming Leader. State: Replica: efd9468d7d29480aad572fa9bd310e9e, State: Running, Role: LEADER
I20260924 12:58:17.585944 31827 consensus_queue.cc:237] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423ea952bdf497ab9d96b5150346282" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38489 } } peers { permanent_uuid: "efd9468d7d29480aad572fa9bd310e9e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 35271 } } peers { permanent_uuid: "d05bb2157ff348d4b64574a3bb0ae905" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39797 } }
I20260924 12:58:17.593209 31353 catalog_manager.cc:5495] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e reported cstate change: term changed from 0 to 1, leader changed from <none> to efd9468d7d29480aad572fa9bd310e9e (127.11.49.67). New cstate: current_term: 1 leader_uuid: "efd9468d7d29480aad572fa9bd310e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a423ea952bdf497ab9d96b5150346282" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efd9468d7d29480aad572fa9bd310e9e" member_type: VOTER last_known_addr { host: "127.11.49.67" port: 35271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d05bb2157ff348d4b64574a3bb0ae905" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39797 } health_report { overall_health: UNKNOWN } } }
I20260924 12:58:17.700631 31818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.692776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40680 (local address 127.11.49.67:35271)
0924 12:58:17.693136 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:17.693145 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:17.693628 (+ 483us) server_negotiation.cc:407] Connection header received
0924 12:58:17.693953 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:17.693964 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:17.694069 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:17.694266 (+ 197us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:58:17.694787 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.695598 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.697729 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.698316 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.698500 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.699138 (+ 638us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:58:17.699838 (+ 700us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:58:17.700026 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:17.700150 (+ 124us) server_negotiation.cc:299] Negotiation successful
0924 12:58:17.700304 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260924 12:58:17.711166 31626 raft_consensus.cc:1261] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282 [term 1 FOLLOWER]: Refusing update from remote peer efd9468d7d29480aad572fa9bd310e9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:58:17.711166 31495 raft_consensus.cc:1261] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905 [term 1 FOLLOWER]: Refusing update from remote peer efd9468d7d29480aad572fa9bd310e9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:58:17.712744 31827 consensus_queue.cc:1035] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a423ea952bdf497ab9d96b5150346282" member_type: VOTER last_known_addr { host: "127.11.49.66" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:58:17.713236 31829 consensus_queue.cc:1035] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d05bb2157ff348d4b64574a3bb0ae905" member_type: VOTER last_known_addr { host: "127.11.49.65" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:58:17.733428 31834 mvcc.cc:205] Tried to move back new op lower bound from 7332883241811853312 to 7332883241318043648. Current Snapshot: MvccSnapshot[applied={T|T < 7332883241811853312}]
I20260924 12:58:17.750717 31353 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:58:17.751106 31353 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 12:58:17.755900 31353 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 759aef0603a6489dabefeeef6ba06c1f: Sending DeleteTablet for 3 replicas of tablet e8910af1ede049a186bb4601fcf60425
I20260924 12:58:17.757664 31475 tablet_service.cc:1514] Processing DeleteTablet for tablet e8910af1ede049a186bb4601fcf60425 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:17 UTC) from {username='slave'} at 127.0.0.1:34194
I20260924 12:58:17.757778 31606 tablet_service.cc:1514] Processing DeleteTablet for tablet e8910af1ede049a186bb4601fcf60425 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:17 UTC) from {username='slave'} at 127.0.0.1:54980
I20260924 12:58:17.758051 31736 tablet_service.cc:1514] Processing DeleteTablet for tablet e8910af1ede049a186bb4601fcf60425 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 12:58:17 UTC) from {username='slave'} at 127.0.0.1:40672
I20260924 12:58:17.760084 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 31413
I20260924 12:58:17.770490 31845 tablet_replica.cc:330] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: stopping tablet replica
I20260924 12:58:17.771347 31843 tablet_replica.cc:330] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: stopping tablet replica
I20260924 12:58:17.771822 31843 raft_consensus.cc:2229] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:58:17.772439 31843 raft_consensus.cc:2258] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:17.772776 31845 raft_consensus.cc:2229] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 1 LEADER]: Raft consensus shutting down.
I20260924 12:58:17.773479 31844 tablet_replica.cc:330] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: stopping tablet replica
I20260924 12:58:17.773962 31844 raft_consensus.cc:2229] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 12:58:17.774305 31845 raft_consensus.cc:2258] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:17.774566 31844 raft_consensus.cc:2258] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 12:58:17.775471 31843 ts_tablet_manager.cc:1905] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:17.776952 31845 ts_tablet_manager.cc:1905] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:17.776942 31844 ts_tablet_manager.cc:1905] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 12:58:17.785478 31844 ts_tablet_manager.cc:1918] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:17.785753 31844 log.cc:1196] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-1/wal/wals/e8910af1ede049a186bb4601fcf60425
I20260924 12:58:17.785750 31845 ts_tablet_manager.cc:1918] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:17.785933 31845 log.cc:1196] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-2/wal/wals/e8910af1ede049a186bb4601fcf60425
I20260924 12:58:17.786417 31844 ts_tablet_manager.cc:1939] T e8910af1ede049a186bb4601fcf60425 P a423ea952bdf497ab9d96b5150346282: Deleting consensus metadata
I20260924 12:58:17.786564 31845 ts_tablet_manager.cc:1939] T e8910af1ede049a186bb4601fcf60425 P efd9468d7d29480aad572fa9bd310e9e: Deleting consensus metadata
I20260924 12:58:17.788754 31341 catalog_manager.cc:4841] TS a423ea952bdf497ab9d96b5150346282 (127.11.49.66:38489): tablet e8910af1ede049a186bb4601fcf60425 (table test-table [id=acaeacbe10764789bd51d5e734ea4d58]) successfully deleted
I20260924 12:58:17.789412 31341 catalog_manager.cc:4841] TS efd9468d7d29480aad572fa9bd310e9e (127.11.49.67:35271): tablet e8910af1ede049a186bb4601fcf60425 (table test-table [id=acaeacbe10764789bd51d5e734ea4d58]) successfully deleted
I20260924 12:58:17.800887 31843 ts_tablet_manager.cc:1918] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 12:58:17.801141 31843 log.cc:1196] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: Deleting WAL directory at /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790254326970360-11461-0/minicluster-data/ts-0/wal/wals/e8910af1ede049a186bb4601fcf60425
I20260924 12:58:17.801779 31843 ts_tablet_manager.cc:1939] T e8910af1ede049a186bb4601fcf60425 P d05bb2157ff348d4b64574a3bb0ae905: Deleting consensus metadata
I20260924 12:58:17.802924 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.761901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34206 (local address 127.11.49.65:39797)
0924 12:58:17.762147 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:17.762156 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:17.766943 (+ 4787us) server_negotiation.cc:407] Connection header received
0924 12:58:17.767314 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:17.767322 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:17.767528 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:17.767704 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:17.784714 (+ 17010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.786041 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.795834 (+ 9793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.796951 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.797214 (+ 263us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.799879 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:17.799897 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:17.799923 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:17.801330 (+ 1407us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:17.801427 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:17.801463 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:17.801611 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:17.801934 (+ 323us) server_negotiation.cc:299] Negotiation successful
0924 12:58:17.802119 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260924 12:58:17.804073 31535 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:17.918996 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 31413
I20260924 12:58:17.919749 31340 catalog_manager.cc:4841] TS d05bb2157ff348d4b64574a3bb0ae905 (127.11.49.65:39797): tablet e8910af1ede049a186bb4601fcf60425 (table test-table [id=acaeacbe10764789bd51d5e734ea4d58]) successfully deleted
I20260924 12:58:17.948962 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 31544
I20260924 12:58:17.959263 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:17.949894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54986 (local address 127.11.49.66:38489)
0924 12:58:17.950185 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:17.950195 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:17.950225 (+ 30us) server_negotiation.cc:407] Connection header received
0924 12:58:17.950318 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:17.950325 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:17.950505 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:17.950668 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:17.951136 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.952628 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.954301 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:17.955039 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:17.955215 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:17.956574 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:17.956588 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:17.956612 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:17.957931 (+ 1319us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:17.958034 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:17.958083 (+ 49us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:17.958313 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:17.958581 (+ 268us) server_negotiation.cc:299] Negotiation successful
0924 12:58:17.958760 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260924 12:58:17.960335 31666 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:18.083297 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 31544
I20260924 12:58:18.102165 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 31674
I20260924 12:58:18.111389 31818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:18.103101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40694 (local address 127.11.49.67:35271)
0924 12:58:18.103298 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:18.103303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:18.103330 (+ 27us) server_negotiation.cc:407] Connection header received
0924 12:58:18.103586 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:18.103591 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:18.103682 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:18.103779 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:18.104372 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:18.105287 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:18.107414 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:18.107933 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:18.108053 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:18.109768 (+ 1715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:18.109777 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:18.109793 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:18.110459 (+ 666us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:18.110514 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:18.110536 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:18.110636 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:18.110830 (+ 194us) server_negotiation.cc:299] Negotiation successful
0924 12:58:18.110961 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260924 12:58:18.112161 31796 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:18.257817 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 31674
I20260924 12:58:18.283118 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 31323
I20260924 12:58:18.284530 31384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:18.416232 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 31323
2026-09-24T12:58:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3636 ms)
[----------] 6 tests from EncryptionPolicyTest (25814 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:18 dist-test-slave-m9hg krb5kdc[31853](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:18 dist-test-slave-m9hg krb5kdc[31853](info): set up 2 sockets
Sep 24 12:58:18 dist-test-slave-m9hg krb5kdc[31853](info): commencing operation
krb5kdc: starting...
W20260924 12:58:19.589702 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.002s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:19 dist-test-slave-m9hg krb5kdc[31853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:19.928195 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41887
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:20.290551 31866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:20.290997 31866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:20.291178 31866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:20.299724 31866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:20.299965 31866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:20.300077 31866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:20.300185 31866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:20.300315 31866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:20.310930 31866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41887
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:20.312451 31866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:20.313838 31866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:20.329737 31872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:20.329857 31871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:20.329864 31874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:20.331029 31866 server_base.cc:1034] running on GCE node
I20260924 12:58:20.332458 31866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:20.335052 31866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:20.336480 31866 hybrid_clock.cc:648] HybridClock initialized: now 1790254700336385 us; error 87 us; skew 500 ppm
I20260924 12:58:20.337051 31866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:20 dist-test-slave-m9hg krb5kdc[31853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254700, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:20.347781 31866 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:20.350279 31866 webserver.cc:460] Webserver started at http://127.0.0.1:37669/ using document root <none> and password file <none>
I20260924 12:58:20.351294 31866 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:20.351488 31866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:20.351893 31866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:20.355964 31866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "b6c05261990049b5b2a649bff69a65cf"
format_stamp: "Formatted at 2026-09-24 12:58:20 on dist-test-slave-m9hg"
server_key: "ad118541076b6e5e26e5ff743e7e8bab"
server_key_iv: "e52d5dfcda9bdfd6253682acba0ebeab"
server_key_version: "encryptionkey@0"
I20260924 12:58:20.357131 31866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "b6c05261990049b5b2a649bff69a65cf"
format_stamp: "Formatted at 2026-09-24 12:58:20 on dist-test-slave-m9hg"
server_key: "ad118541076b6e5e26e5ff743e7e8bab"
server_key_iv: "e52d5dfcda9bdfd6253682acba0ebeab"
server_key_version: "encryptionkey@0"
I20260924 12:58:20.364538 31866 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260924 12:58:20.370342 31881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:20.372689 31866 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.007s sys 0.000s
I20260924 12:58:20.373008 31866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "b6c05261990049b5b2a649bff69a65cf"
format_stamp: "Formatted at 2026-09-24 12:58:20 on dist-test-slave-m9hg"
server_key: "ad118541076b6e5e26e5ff743e7e8bab"
server_key_iv: "e52d5dfcda9bdfd6253682acba0ebeab"
server_key_version: "encryptionkey@0"
I20260924 12:58:20.373306 31866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:20.402456 31866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:20.408797 31866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:20.409219 31866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:20.434237 31866 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41887
I20260924 12:58:20.434285 31932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41887 every 8 connection(s)
I20260924 12:58:20.436189 31866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:20.440702 31933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:20.444844 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 31866
I20260924 12:58:20.445152 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:20.445928 11461 external_mini_cluster.cc:1428] Setting key 873baf6b2d4144740ccfd55e1454a181
I20260924 12:58:20.453425 31933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf: Bootstrap starting.
I20260924 12:58:20.457737 31933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:20.459235 31933 log.cc:824] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:20.463763 31933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf: No bootstrap required, opened a new log
Sep 24 12:58:20 dist-test-slave-m9hg krb5kdc[31853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260924 12:58:20.474105 31933 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6c05261990049b5b2a649bff69a65cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41887 } }
I20260924 12:58:20.474611 31933 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:20.474753 31933 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6c05261990049b5b2a649bff69a65cf, State: Initialized, Role: FOLLOWER
I20260924 12:58:20.475441 31933 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6c05261990049b5b2a649bff69a65cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41887 } }
I20260924 12:58:20.475742 31933 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:20.475934 31933 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:20.476155 31933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:20.479625 31933 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6c05261990049b5b2a649bff69a65cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41887 } }
I20260924 12:58:20.480379 31933 leader_election.cc:302] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6c05261990049b5b2a649bff69a65cf; no voters:
I20260924 12:58:20.481134 31933 leader_election.cc:288] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:20.481400 31938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:20.482118 31936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:20.449051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47741 (local address 127.0.0.1:41887)
0924 12:58:20.450453 (+ 1402us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:20.450477 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:20.451113 (+ 636us) server_negotiation.cc:407] Connection header received
0924 12:58:20.453761 (+ 2648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:20.453794 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:20.454420 (+ 626us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:20.455043 (+ 623us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:20.457217 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:20.459395 (+ 2178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:20.461740 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:20.462907 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:20.463163 (+ 256us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:20.469298 (+ 6135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:20.469316 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:20.469340 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:20.469406 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:20.474152 (+ 4746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:20.476040 (+ 1888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:20.476056 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:20.476072 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:20.476468 (+ 396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:20.477294 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:20.477298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:20.477302 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:20.478164 (+ 862us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:20.478640 (+ 476us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:20.479439 (+ 799us) server_negotiation.cc:299] Negotiation successful
0924 12:58:20.479979 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1029,"thread_start_us":649,"threads_started":1}
I20260924 12:58:20.483219 31938 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [term 1 LEADER]: Becoming Leader. State: Replica: b6c05261990049b5b2a649bff69a65cf, State: Running, Role: LEADER
I20260924 12:58:20.483922 31933 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:20.484011 31938 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6c05261990049b5b2a649bff69a65cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41887 } }
I20260924 12:58:20.488991 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:20.494134 31939 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6c05261990049b5b2a649bff69a65cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6c05261990049b5b2a649bff69a65cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41887 } } }
I20260924 12:58:20.494634 31939 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:20.495235 31940 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6c05261990049b5b2a649bff69a65cf. Latest consensus state: current_term: 1 leader_uuid: "b6c05261990049b5b2a649bff69a65cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6c05261990049b5b2a649bff69a65cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41887 } } }
I20260924 12:58:20.495577 31940 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:20.503055 31947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:20.527630 31947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:20.552858 31947 catalog_manager.cc:1347] Generated new cluster ID: 1dd7ca0c3aa44999b1313b3ae6f5b743
I20260924 12:58:20.553012 31947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:20.557925 31936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:20.522199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52635 (local address 127.0.0.1:41887)
0924 12:58:20.522503 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:20.522512 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:20.523870 (+ 1358us) server_negotiation.cc:407] Connection header received
0924 12:58:20.524377 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:20.524388 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:20.524861 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:20.525072 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:20.529315 (+ 4243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:20.531260 (+ 1945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:20.535500 (+ 4240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:20.536693 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:20.536900 (+ 207us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:20.543239 (+ 6339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:20.543254 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:20.543263 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:20.543363 (+ 100us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:20.549906 (+ 6543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:20.551910 (+ 2004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:20.551922 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:20.551929 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:20.552245 (+ 316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:20.553168 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:20.553177 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:20.553183 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:20.553811 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:20.554327 (+ 516us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:20.556816 (+ 2489us) server_negotiation.cc:299] Negotiation successful
0924 12:58:20.557229 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260924 12:58:20.574551 31947 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:20.576946 31947 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:20.586859 31947 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6c05261990049b5b2a649bff69a65cf: Generated new TSK 0
I20260924 12:58:20.588219 31947 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:20.596297 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 31866
I20260924 12:58:20.598280 31928 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:20.699898 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 31866
W20260924 12:58:20.720456 31851 connection.cc:535] client connection to 127.0.0.1:41887 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41887): Connection reset by peer (error 104)
2026-09-24T12:58:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2280 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:20 dist-test-slave-m9hg krb5kdc[31965](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:20 dist-test-slave-m9hg krb5kdc[31965](info): set up 2 sockets
Sep 24 12:58:20 dist-test-slave-m9hg krb5kdc[31965](info): commencing operation
krb5kdc: starting...
W20260924 12:58:21.877744 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:22 dist-test-slave-m9hg krb5kdc[31965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:22.205461 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39911
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39911
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:22.638128 31978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:22.638569 31978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:22.638759 31978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:22.647411 31978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:22.647595 31978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:22.647718 31978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:22.647843 31978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:22.648123 31978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:22.661294 31978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39911
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:22.663220 31978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:22.665059 31978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:22.682906 31983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:22.682986 31986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:22.682932 31984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:22.684499 31978 server_base.cc:1034] running on GCE node
I20260924 12:58:22.685742 31978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:22.688109 31978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:22.689432 31978 hybrid_clock.cc:648] HybridClock initialized: now 1790254702689368 us; error 49 us; skew 500 ppm
I20260924 12:58:22.690026 31978 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:22 dist-test-slave-m9hg krb5kdc[31965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254702, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:22.694602 31978 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:22.697402 31978 webserver.cc:460] Webserver started at http://127.0.0.1:36347/ using document root <none> and password file <none>
I20260924 12:58:22.698470 31978 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:22.698655 31978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:22.699098 31978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:22.703740 31978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "64d1e7c3a99e45c7be519d17bb907697"
format_stamp: "Formatted at 2026-09-24 12:58:22 on dist-test-slave-m9hg"
server_key: "3ffaa677aca4957eb237ac04d1faaa17"
server_key_iv: "e2f34573951b327e28bebcfd74f61ad4"
server_key_version: "encryptionkey@0"
I20260924 12:58:22.705117 31978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "64d1e7c3a99e45c7be519d17bb907697"
format_stamp: "Formatted at 2026-09-24 12:58:22 on dist-test-slave-m9hg"
server_key: "3ffaa677aca4957eb237ac04d1faaa17"
server_key_iv: "e2f34573951b327e28bebcfd74f61ad4"
server_key_version: "encryptionkey@0"
I20260924 12:58:22.713093 31978 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260924 12:58:22.718413 31993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:22.720731 31978 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.001s
I20260924 12:58:22.721093 31978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "64d1e7c3a99e45c7be519d17bb907697"
format_stamp: "Formatted at 2026-09-24 12:58:22 on dist-test-slave-m9hg"
server_key: "3ffaa677aca4957eb237ac04d1faaa17"
server_key_iv: "e2f34573951b327e28bebcfd74f61ad4"
server_key_version: "encryptionkey@0"
I20260924 12:58:22.721360 31978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:22.753391 31978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:22.759781 31978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:22.760231 31978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:22.786152 31978 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39911
I20260924 12:58:22.786157 32044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39911 every 8 connection(s)
I20260924 12:58:22.788319 31978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:22.790817 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 31978
I20260924 12:58:22.791090 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:22.791666 11461 external_mini_cluster.cc:1428] Setting key 15d08c5d868ebf54981d862efbd0803d
I20260924 12:58:22.794571 32045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:22.811671 32048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:22.794423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46825 (local address 127.0.0.1:39911)
0924 12:58:22.795887 (+ 1464us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:22.795904 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:22.795962 (+ 58us) server_negotiation.cc:407] Connection header received
0924 12:58:22.798118 (+ 2156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:22.798154 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:22.798827 (+ 673us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:22.799343 (+ 516us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:22.800459 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:22.802138 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:22.804472 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:22.805429 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:22.805657 (+ 228us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:22.807766 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:22.807781 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:22.807810 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:22.808709 (+ 899us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:22.808830 (+ 121us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:22.808872 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:22.809761 (+ 889us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:22.809965 (+ 204us) server_negotiation.cc:299] Negotiation successful
0924 12:58:22.810167 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1136,"thread_start_us":615,"threads_started":1}
I20260924 12:58:22.811972 32045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697: Bootstrap starting.
I20260924 12:58:22.815997 32045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:22.817574 32045 log.cc:824] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:22.819317 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:22.822022 32045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697: No bootstrap required, opened a new log
I20260924 12:58:22.833341 32045 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1e7c3a99e45c7be519d17bb907697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39911 } }
I20260924 12:58:22.834015 32048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:22.825336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49993 (local address 127.0.0.1:39911)
0924 12:58:22.825703 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:22.825711 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:22.826114 (+ 403us) server_negotiation.cc:407] Connection header received
0924 12:58:22.826392 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:22.826401 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:22.826553 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:22.826669 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:22.827511 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:22.828876 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:22.830605 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:22.831349 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:22.831510 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:22.833108 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:22.833115 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:22.833120 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:22.833146 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:22.833205 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:22.833227 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:22.833386 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:22.833564 (+ 178us) server_negotiation.cc:299] Negotiation successful
0924 12:58:22.833640 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260924 12:58:22.834051 32045 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:22.834192 32045 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d1e7c3a99e45c7be519d17bb907697, State: Initialized, Role: FOLLOWER
I20260924 12:58:22.835017 32045 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1e7c3a99e45c7be519d17bb907697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39911 } }
I20260924 12:58:22.835273 32045 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:22.835475 32045 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:22.835703 32045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:22.838270 32045 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1e7c3a99e45c7be519d17bb907697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39911 } }
I20260924 12:58:22.838907 32045 leader_election.cc:302] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64d1e7c3a99e45c7be519d17bb907697; no voters:
I20260924 12:58:22.839680 32045 leader_election.cc:288] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:22.839982 32055 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:22.841542 32055 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [term 1 LEADER]: Becoming Leader. State: Replica: 64d1e7c3a99e45c7be519d17bb907697, State: Running, Role: LEADER
I20260924 12:58:22.842206 32045 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:22.842442 32055 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1e7c3a99e45c7be519d17bb907697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39911 } }
I20260924 12:58:22.846359 32056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64d1e7c3a99e45c7be519d17bb907697" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1e7c3a99e45c7be519d17bb907697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39911 } } }
I20260924 12:58:22.846473 32057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64d1e7c3a99e45c7be519d17bb907697. Latest consensus state: current_term: 1 leader_uuid: "64d1e7c3a99e45c7be519d17bb907697" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1e7c3a99e45c7be519d17bb907697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39911 } } }
I20260924 12:58:22.846994 32056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:22.847034 32057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:22.848201 32065 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:22.855741 32065 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:22.867952 32065 catalog_manager.cc:1347] Generated new cluster ID: 90d9e20aef9b4aec90c6f4774f65eeb7
I20260924 12:58:22.868121 32065 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:22.887351 32065 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:22.889312 32065 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:22.916440 32065 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64d1e7c3a99e45c7be519d17bb907697: Generated new TSK 0
I20260924 12:58:22.918047 32065 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:22.932816 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 31978
W20260924 12:58:22.934667 32040 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46825
W20260924 12:58:22.936215 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 31978: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:22.936612 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 31978
W20260924 12:58:22.957163 31963 connection.cc:535] client connection to 127.0.0.1:39911 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39911): Connection reset by peer (error 104)
2026-09-24T12:58:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2235 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:23 dist-test-slave-m9hg krb5kdc[32076](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:23 dist-test-slave-m9hg krb5kdc[32076](info): set up 2 sockets
Sep 24 12:58:23 dist-test-slave-m9hg krb5kdc[32076](info): commencing operation
krb5kdc: starting...
W20260924 12:58:24.125972 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:24 dist-test-slave-m9hg krb5kdc[32076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:24.465423 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46061
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:24.915491 32089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:24.915944 32089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:24.916066 32089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:24.925557 32089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:24.925760 32089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:24.925815 32089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:24.925882 32089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:24.925935 32089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:24.941311 32089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46061
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:24.943178 32089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:24.945031 32089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:24.965332 32097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:24.965344 32094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:24.966272 32095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:24.966955 32089 server_base.cc:1034] running on GCE node
I20260924 12:58:24.968024 32089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:24.970187 32089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:24.971812 32089 hybrid_clock.cc:648] HybridClock initialized: now 1790254704971643 us; error 136 us; skew 500 ppm
I20260924 12:58:24.972441 32089 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:24 dist-test-slave-m9hg krb5kdc[32076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254704, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:24.976644 32089 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:24.978979 32089 webserver.cc:460] Webserver started at http://127.0.0.1:40145/ using document root <none> and password file <none>
I20260924 12:58:24.979912 32089 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:24.980088 32089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:24.980543 32089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:24.984414 32089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "95926e960f394fb19e93804426260094"
format_stamp: "Formatted at 2026-09-24 12:58:24 on dist-test-slave-m9hg"
server_key: "49477c7c6f578a8ee5f57248d5df796e"
server_key_iv: "c1f3d4e93f730e6cfb27b9681c796b49"
server_key_version: "encryptionkey@0"
I20260924 12:58:24.985435 32089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "95926e960f394fb19e93804426260094"
format_stamp: "Formatted at 2026-09-24 12:58:24 on dist-test-slave-m9hg"
server_key: "49477c7c6f578a8ee5f57248d5df796e"
server_key_iv: "c1f3d4e93f730e6cfb27b9681c796b49"
server_key_version: "encryptionkey@0"
I20260924 12:58:24.992477 32089 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.002s
I20260924 12:58:24.997262 32104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:24.999825 32089 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260924 12:58:25.000098 32089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "95926e960f394fb19e93804426260094"
format_stamp: "Formatted at 2026-09-24 12:58:24 on dist-test-slave-m9hg"
server_key: "49477c7c6f578a8ee5f57248d5df796e"
server_key_iv: "c1f3d4e93f730e6cfb27b9681c796b49"
server_key_version: "encryptionkey@0"
I20260924 12:58:25.000624 32089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:25.007601 32089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:25.014139 32089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:25.014577 32089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:25.044697 32089 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46061
I20260924 12:58:25.045110 32155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46061 every 8 connection(s)
I20260924 12:58:25.046698 32089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:25.051621 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 32089
I20260924 12:58:25.051816 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:25.052399 11461 external_mini_cluster.cc:1428] Setting key 636d5656457da0a4cfdf5862fff55344
I20260924 12:58:25.053148 32156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:25.062593 32159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:25.054914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49457 (local address 127.0.0.1:46061)
0924 12:58:25.055885 (+ 971us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:25.055900 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:25.055948 (+ 48us) server_negotiation.cc:407] Connection header received
0924 12:58:25.057786 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:25.057815 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:25.058275 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:25.058704 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:25.060487 (+ 1783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:25.060494 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:25.060510 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:25.060529 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:25.060636 (+ 107us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:25.060662 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:25.060918 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:25.061103 (+ 185us) server_negotiation.cc:299] Negotiation successful
0924 12:58:25.061367 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":692,"thread_start_us":438,"threads_started":1}
I20260924 12:58:25.067392 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:25.071511 32156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094: Bootstrap starting.
I20260924 12:58:25.075601 32159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:25.072438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59289 (local address 127.0.0.1:46061)
0924 12:58:25.072698 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:25.072705 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:25.072877 (+ 172us) server_negotiation.cc:407] Connection header received
0924 12:58:25.073056 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:25.073062 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:25.073149 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:25.073326 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:25.074605 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:25.074613 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:25.074619 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:25.074644 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:25.074728 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:25.074756 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:25.074924 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:25.075086 (+ 162us) server_negotiation.cc:299] Negotiation successful
0924 12:58:25.075169 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260924 12:58:25.077155 32156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:25.078658 32156 log.cc:824] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:25.082634 32156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094: No bootstrap required, opened a new log
I20260924 12:58:25.091902 32156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95926e960f394fb19e93804426260094" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46061 } }
I20260924 12:58:25.092626 32156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:25.092890 32156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95926e960f394fb19e93804426260094, State: Initialized, Role: FOLLOWER
I20260924 12:58:25.093839 32156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95926e960f394fb19e93804426260094" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46061 } }
I20260924 12:58:25.094530 32156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:25.094765 32156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:25.095069 32156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:25.098763 32156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95926e960f394fb19e93804426260094" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46061 } }
I20260924 12:58:25.099730 32156 leader_election.cc:302] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95926e960f394fb19e93804426260094; no voters:
I20260924 12:58:25.100734 32156 leader_election.cc:288] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:25.100911 32166 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:25.101850 32166 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [term 1 LEADER]: Becoming Leader. State: Replica: 95926e960f394fb19e93804426260094, State: Running, Role: LEADER
I20260924 12:58:25.103744 32166 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95926e960f394fb19e93804426260094" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46061 } }
I20260924 12:58:25.104130 32156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:25.107452 32168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95926e960f394fb19e93804426260094" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95926e960f394fb19e93804426260094" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46061 } } }
I20260924 12:58:25.107425 32167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95926e960f394fb19e93804426260094. Latest consensus state: current_term: 1 leader_uuid: "95926e960f394fb19e93804426260094" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95926e960f394fb19e93804426260094" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46061 } } }
I20260924 12:58:25.108036 32167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:25.108036 32168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:25.111470 32172 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:25.117946 32172 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:25.130337 32172 catalog_manager.cc:1347] Generated new cluster ID: 306a90702da249558dbe4685eb28c743
I20260924 12:58:25.130551 32172 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:25.151171 32172 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:25.151829 32172 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:25.169425 32172 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95926e960f394fb19e93804426260094: Generated new TSK 0
I20260924 12:58:25.170848 32172 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:25.195132 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32089
W20260924 12:58:25.196756 32151 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49457
W20260924 12:58:25.197866 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32089: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:25.198112 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 32089
2026-09-24T12:58:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2263 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:25 dist-test-slave-m9hg krb5kdc[32187](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:25 dist-test-slave-m9hg krb5kdc[32187](info): set up 2 sockets
Sep 24 12:58:25 dist-test-slave-m9hg krb5kdc[32187](info): commencing operation
krb5kdc: starting...
W20260924 12:58:26.393536 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.004s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:26 dist-test-slave-m9hg krb5kdc[32187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:26.717504 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40483
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:27.153083 32200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:27.153565 32200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:27.153755 32200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:27.162403 32200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:27.162633 32200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:27.162765 32200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:27.162884 32200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:27.162977 32200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:27.174777 32200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:27.176689 32200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:27.178364 32200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:27.192901 32205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:27.193156 32208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:27.193241 32206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:27.195091 32200 server_base.cc:1034] running on GCE node
I20260924 12:58:27.196408 32200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:27.198474 32200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:27.199774 32200 hybrid_clock.cc:648] HybridClock initialized: now 1790254707199706 us; error 61 us; skew 500 ppm
I20260924 12:58:27.200241 32200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:27 dist-test-slave-m9hg krb5kdc[32187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254707, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:27.204425 32200 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:27.206540 32200 webserver.cc:460] Webserver started at http://127.0.0.1:44623/ using document root <none> and password file <none>
I20260924 12:58:27.207525 32200 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:27.207722 32200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:27.208137 32200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:27.212896 32200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "ab48fd4b82f146388949c24cf98843aa"
format_stamp: "Formatted at 2026-09-24 12:58:27 on dist-test-slave-m9hg"
server_key: "7a7dcb6f17984aa87e8be8895cfc21dc"
server_key_iv: "e3b60d1d7c3e3007ead5e2509a162066"
server_key_version: "encryptionkey@0"
I20260924 12:58:27.214459 32200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "ab48fd4b82f146388949c24cf98843aa"
format_stamp: "Formatted at 2026-09-24 12:58:27 on dist-test-slave-m9hg"
server_key: "7a7dcb6f17984aa87e8be8895cfc21dc"
server_key_iv: "e3b60d1d7c3e3007ead5e2509a162066"
server_key_version: "encryptionkey@0"
I20260924 12:58:27.222599 32200 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.001s
I20260924 12:58:27.227716 32215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:27.230260 32200 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.002s
I20260924 12:58:27.230607 32200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "ab48fd4b82f146388949c24cf98843aa"
format_stamp: "Formatted at 2026-09-24 12:58:27 on dist-test-slave-m9hg"
server_key: "7a7dcb6f17984aa87e8be8895cfc21dc"
server_key_iv: "e3b60d1d7c3e3007ead5e2509a162066"
server_key_version: "encryptionkey@0"
I20260924 12:58:27.230918 32200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:27.257706 32200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:27.263515 32200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:27.263931 32200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:27.288225 32200 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40483
I20260924 12:58:27.288300 32266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40483 every 8 connection(s)
I20260924 12:58:27.290120 32200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:27.292212 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 32200
I20260924 12:58:27.292449 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:27.293010 11461 external_mini_cluster.cc:1428] Setting key 5057e1453db2608254a1c2a376d60bf6
I20260924 12:58:27.295413 32267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:27.310882 32267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa: Bootstrap starting.
Sep 24 12:58:27 dist-test-slave-m9hg krb5kdc[32187](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260924 12:58:27.314443 32267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:27.315644 32267 log.cc:824] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:27.319006 32267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa: No bootstrap required, opened a new log
I20260924 12:58:27.323658 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:27.295439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59571 (local address 127.0.0.1:40483)
0924 12:58:27.296668 (+ 1229us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:27.296686 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:27.296746 (+ 60us) server_negotiation.cc:407] Connection header received
0924 12:58:27.298734 (+ 1988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:27.298798 (+ 64us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:27.299476 (+ 678us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:27.299976 (+ 500us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:27.302014 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:27.303741 (+ 1727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:27.305671 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:27.306669 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:27.306889 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:27.312775 (+ 5886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:27.312793 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:27.312815 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:27.312881 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:27.317679 (+ 4798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:27.318836 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:27.318845 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:27.318853 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:27.319149 (+ 296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:27.319662 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:27.319668 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:27.319679 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:27.320516 (+ 837us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:27.320990 (+ 474us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:27.321521 (+ 531us) server_negotiation.cc:299] Negotiation successful
0924 12:58:27.322161 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":894,"thread_start_us":540,"threads_started":1}
I20260924 12:58:27.328488 32267 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab48fd4b82f146388949c24cf98843aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } }
I20260924 12:58:27.329061 32267 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:27.329190 32267 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab48fd4b82f146388949c24cf98843aa, State: Initialized, Role: FOLLOWER
I20260924 12:58:27.329739 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:27.329872 32267 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab48fd4b82f146388949c24cf98843aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } }
I20260924 12:58:27.330180 32267 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:27.330344 32267 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:27.330551 32267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:27.332967 32267 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab48fd4b82f146388949c24cf98843aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } }
I20260924 12:58:27.333639 32267 leader_election.cc:302] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab48fd4b82f146388949c24cf98843aa; no voters:
I20260924 12:58:27.334489 32267 leader_election.cc:288] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:27.334725 32276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:27.337046 32267 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:27.337128 32276 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [term 1 LEADER]: Becoming Leader. State: Replica: ab48fd4b82f146388949c24cf98843aa, State: Running, Role: LEADER
I20260924 12:58:27.338208 32276 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab48fd4b82f146388949c24cf98843aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } }
I20260924 12:58:27.342872 32279 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab48fd4b82f146388949c24cf98843aa. Latest consensus state: current_term: 1 leader_uuid: "ab48fd4b82f146388949c24cf98843aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab48fd4b82f146388949c24cf98843aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } } }
I20260924 12:58:27.343986 32279 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:27.343876 32277 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab48fd4b82f146388949c24cf98843aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab48fd4b82f146388949c24cf98843aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } } }
I20260924 12:58:27.344437 32277 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:27.350430 32283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:27.359126 32283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:27.363395 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:27.335900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45279 (local address 127.0.0.1:40483)
0924 12:58:27.336213 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:27.336224 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:27.339247 (+ 3023us) server_negotiation.cc:407] Connection header received
0924 12:58:27.339503 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:27.339509 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:27.339605 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:27.339730 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:27.342002 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:27.343254 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:27.347165 (+ 3911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:27.347882 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:27.348083 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:27.352236 (+ 4153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:27.352243 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:27.352248 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:27.352396 (+ 148us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:27.357401 (+ 5005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:27.358785 (+ 1384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:27.358793 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:27.358797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:27.359197 (+ 400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:27.359860 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:27.359866 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:27.359871 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:27.360471 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:27.360828 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:27.362562 (+ 1734us) server_negotiation.cc:299] Negotiation successful
0924 12:58:27.362884 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260924 12:58:27.374737 32283 catalog_manager.cc:1347] Generated new cluster ID: 5f1796b824ef4ee4878f0e976a0f5f6b
I20260924 12:58:27.374902 32283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:27.397413 32283 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:27.399855 32283 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:27.412597 32283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab48fd4b82f146388949c24cf98843aa: Generated new TSK 0
I20260924 12:58:27.414183 32283 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:27.433248 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32200
I20260924 12:58:27.435038 32262 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:27.546167 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 32200
2026-09-24T12:58:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2347 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:27 dist-test-slave-m9hg krb5kdc[32299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:27 dist-test-slave-m9hg krb5kdc[32299](info): set up 2 sockets
Sep 24 12:58:27 dist-test-slave-m9hg krb5kdc[32299](info): commencing operation
krb5kdc: starting...
W20260924 12:58:28.757501 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:28 dist-test-slave-m9hg krb5kdc[32299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:29.085594 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38965
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38965
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:29.542999 32312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:29.543481 32312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:29.543711 32312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:29.552736 32312 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:29.552923 32312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:29.553049 32312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:29.553195 32312 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:29.553269 32312 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:29.567739 32312 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:29.569713 32312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:29.571501 32312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:29.590407 32317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:29.590533 32320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:29.590570 32318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:29.592185 32312 server_base.cc:1034] running on GCE node
I20260924 12:58:29.593653 32312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:29.596565 32312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:29.597927 32312 hybrid_clock.cc:648] HybridClock initialized: now 1790254709597880 us; error 108 us; skew 500 ppm
I20260924 12:58:29.598511 32312 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:29 dist-test-slave-m9hg krb5kdc[32299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254709, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:29.603065 32312 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:29.605471 32312 webserver.cc:460] Webserver started at http://127.0.0.1:33725/ using document root <none> and password file <none>
I20260924 12:58:29.606673 32312 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:29.606875 32312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:29.607301 32312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:29.611418 32312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "d08e62e1dcff462baa02a57c42265cfb"
format_stamp: "Formatted at 2026-09-24 12:58:29 on dist-test-slave-m9hg"
server_key: "f775acc52dcbf67d888f5b1f55b126f4"
server_key_iv: "80754c1c9b1f0b28db56b5c2476ccf3a"
server_key_version: "encryptionkey@0"
I20260924 12:58:29.612648 32312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "d08e62e1dcff462baa02a57c42265cfb"
format_stamp: "Formatted at 2026-09-24 12:58:29 on dist-test-slave-m9hg"
server_key: "f775acc52dcbf67d888f5b1f55b126f4"
server_key_iv: "80754c1c9b1f0b28db56b5c2476ccf3a"
server_key_version: "encryptionkey@0"
I20260924 12:58:29.620041 32312 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260924 12:58:29.625310 32327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:29.627610 32312 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260924 12:58:29.627950 32312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "d08e62e1dcff462baa02a57c42265cfb"
format_stamp: "Formatted at 2026-09-24 12:58:29 on dist-test-slave-m9hg"
server_key: "f775acc52dcbf67d888f5b1f55b126f4"
server_key_iv: "80754c1c9b1f0b28db56b5c2476ccf3a"
server_key_version: "encryptionkey@0"
I20260924 12:58:29.628278 32312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:29.646091 32312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:29.652154 32312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:29.652587 32312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:29.678809 32312 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38965
I20260924 12:58:29.678673 32378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38965 every 8 connection(s)
I20260924 12:58:29.680903 32312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:29.682516 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 32312
I20260924 12:58:29.682840 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:29.683386 11461 external_mini_cluster.cc:1428] Setting key dd5f86ef07e1dc57a2a571357f9b0cde
I20260924 12:58:29.686766 32379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:29.703217 32379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb: Bootstrap starting.
I20260924 12:58:29.703913 32382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:29.685876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35023 (local address 127.0.0.1:38965)
0924 12:58:29.687019 (+ 1143us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:29.687036 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:29.687097 (+ 61us) server_negotiation.cc:407] Connection header received
0924 12:58:29.689556 (+ 2459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:29.689594 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:29.690267 (+ 673us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:29.690895 (+ 628us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:29.691765 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:29.693731 (+ 1966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:29.696214 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:29.697930 (+ 1716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:29.698174 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:29.700177 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:29.700192 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:29.700217 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:29.701238 (+ 1021us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:29.701365 (+ 127us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:29.701406 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:29.701550 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:29.701977 (+ 427us) server_negotiation.cc:299] Negotiation successful
0924 12:58:29.702473 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":807,"thread_start_us":501,"threads_started":1}
I20260924 12:58:29.707108 32379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:29.708562 32379 log.cc:824] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:29.709754 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:29.712829 32379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb: No bootstrap required, opened a new log
I20260924 12:58:29.723587 32382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:29.715227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50807 (local address 127.0.0.1:38965)
0924 12:58:29.715487 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:29.715495 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:29.715922 (+ 427us) server_negotiation.cc:407] Connection header received
0924 12:58:29.716116 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:29.716125 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:29.716250 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:29.716470 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:29.717248 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:29.718488 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:29.720143 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:29.721007 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:29.721189 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:29.722593 (+ 1404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:29.722601 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:29.722607 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:29.722638 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:29.722711 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:29.722736 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:29.722863 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:29.723032 (+ 169us) server_negotiation.cc:299] Negotiation successful
0924 12:58:29.723169 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260924 12:58:29.724844 32379 raft_consensus.cc:348] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08e62e1dcff462baa02a57c42265cfb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38965 } }
I20260924 12:58:29.725494 32379 raft_consensus.cc:374] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:29.725663 32379 raft_consensus.cc:729] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08e62e1dcff462baa02a57c42265cfb, State: Initialized, Role: FOLLOWER
I20260924 12:58:29.726460 32379 consensus_queue.cc:260] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08e62e1dcff462baa02a57c42265cfb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38965 } }
I20260924 12:58:29.726740 32379 raft_consensus.cc:388] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:29.726861 32379 raft_consensus.cc:482] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:29.727036 32379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:29.730306 32379 raft_consensus.cc:504] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08e62e1dcff462baa02a57c42265cfb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38965 } }
I20260924 12:58:29.731001 32379 leader_election.cc:302] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d08e62e1dcff462baa02a57c42265cfb; no voters:
I20260924 12:58:29.731776 32379 leader_election.cc:288] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:29.732067 32389 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:29.733132 32389 raft_consensus.cc:686] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [term 1 LEADER]: Becoming Leader. State: Replica: d08e62e1dcff462baa02a57c42265cfb, State: Running, Role: LEADER
I20260924 12:58:29.734051 32389 consensus_queue.cc:237] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08e62e1dcff462baa02a57c42265cfb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38965 } }
I20260924 12:58:29.734824 32379 sys_catalog.cc:564] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:29.738063 32390 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d08e62e1dcff462baa02a57c42265cfb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08e62e1dcff462baa02a57c42265cfb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38965 } } }
I20260924 12:58:29.738489 32391 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d08e62e1dcff462baa02a57c42265cfb. Latest consensus state: current_term: 1 leader_uuid: "d08e62e1dcff462baa02a57c42265cfb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08e62e1dcff462baa02a57c42265cfb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38965 } } }
I20260924 12:58:29.739238 32390 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:29.740432 32391 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:29.742763 32398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:29.749214 32398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:29.767772 32398 catalog_manager.cc:1347] Generated new cluster ID: 929a1830f21a43fa8aca1eff2b84b5e1
I20260924 12:58:29.767956 32398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:29.782979 32398 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:29.784574 32398 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:29.797006 32398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d08e62e1dcff462baa02a57c42265cfb: Generated new TSK 0
I20260924 12:58:29.797991 32398 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:29.814477 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32312
W20260924 12:58:29.816076 32374 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35023
W20260924 12:58:29.817059 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32312: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:29.817298 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 32312
2026-09-24T12:58:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2268 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:29 dist-test-slave-m9hg krb5kdc[32410](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:29 dist-test-slave-m9hg krb5kdc[32410](info): set up 2 sockets
Sep 24 12:58:29 dist-test-slave-m9hg krb5kdc[32410](info): commencing operation
krb5kdc: starting...
W20260924 12:58:30.985479 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:31 dist-test-slave-m9hg krb5kdc[32410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:31.313424 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42817
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42817
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:31.759436 32423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:31.759999 32423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:31.760227 32423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:31.769532 32423 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:31.769794 32423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:31.769923 32423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:31.770051 32423 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:31.770155 32423 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:31.782861 32423 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:31.784852 32423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:31.786669 32423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:31.803807 32428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:31.803851 32429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:31.803903 32431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:31.805148 32423 server_base.cc:1034] running on GCE node
I20260924 12:58:31.806236 32423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:31.808133 32423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:31.809473 32423 hybrid_clock.cc:648] HybridClock initialized: now 1790254711809423 us; error 71 us; skew 500 ppm
I20260924 12:58:31.809949 32423 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:31 dist-test-slave-m9hg krb5kdc[32410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254711, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:31.819986 32423 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:31.822398 32423 webserver.cc:460] Webserver started at http://127.0.0.1:38283/ using document root <none> and password file <none>
I20260924 12:58:31.823277 32423 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:31.823472 32423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:31.823839 32423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:31.827373 32423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "71ecd8c666764cb88ea0c52068723131"
format_stamp: "Formatted at 2026-09-24 12:58:31 on dist-test-slave-m9hg"
server_key: "13dafa7fe70edfe6ac40b246750fdb46"
server_key_iv: "1a393cefd16296bacf642cba0066f885"
server_key_version: "encryptionkey@0"
I20260924 12:58:31.828342 32423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "71ecd8c666764cb88ea0c52068723131"
format_stamp: "Formatted at 2026-09-24 12:58:31 on dist-test-slave-m9hg"
server_key: "13dafa7fe70edfe6ac40b246750fdb46"
server_key_iv: "1a393cefd16296bacf642cba0066f885"
server_key_version: "encryptionkey@0"
I20260924 12:58:31.834802 32423 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260924 12:58:31.839715 32438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:31.841763 32423 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260924 12:58:31.842043 32423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "71ecd8c666764cb88ea0c52068723131"
format_stamp: "Formatted at 2026-09-24 12:58:31 on dist-test-slave-m9hg"
server_key: "13dafa7fe70edfe6ac40b246750fdb46"
server_key_iv: "1a393cefd16296bacf642cba0066f885"
server_key_version: "encryptionkey@0"
I20260924 12:58:31.842299 32423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:31.849473 32423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:31.854588 32423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:31.854959 32423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:31.879554 32423 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42817
I20260924 12:58:31.879669 32489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42817 every 8 connection(s)
I20260924 12:58:31.881338 32423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:31.886611 32490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:31.888602 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 32423
I20260924 12:58:31.888856 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:31.889464 11461 external_mini_cluster.cc:1428] Setting key 39f0d055cd24f5cc866a986c5f25f16c
I20260924 12:58:31.899879 32493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:31.891819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58229 (local address 127.0.0.1:42817)
0924 12:58:31.893249 (+ 1430us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:31.893266 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:31.893334 (+ 68us) server_negotiation.cc:407] Connection header received
0924 12:58:31.895502 (+ 2168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:31.895536 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:31.896057 (+ 521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:31.896642 (+ 585us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:31.897930 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:31.897937 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:31.897954 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:31.897972 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:31.898045 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:31.898072 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:31.898353 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:31.898520 (+ 167us) server_negotiation.cc:299] Negotiation successful
0924 12:58:31.898735 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1069,"thread_start_us":727,"threads_started":1}
I20260924 12:58:31.905200 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:31.905345 32490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131: Bootstrap starting.
I20260924 12:58:31.909412 32490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:31.911028 32490 log.cc:824] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:31.914286 32493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:31.910756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45449 (local address 127.0.0.1:42817)
0924 12:58:31.911004 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:31.911016 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:31.911560 (+ 544us) server_negotiation.cc:407] Connection header received
0924 12:58:31.911792 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:31.911800 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:31.911888 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:31.912061 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:31.913423 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:31.913428 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:31.913431 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:31.913448 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:31.913490 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:31.913506 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:31.913622 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:31.913787 (+ 165us) server_negotiation.cc:299] Negotiation successful
0924 12:58:31.913842 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260924 12:58:31.915563 32490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131: No bootstrap required, opened a new log
I20260924 12:58:31.924714 32490 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ecd8c666764cb88ea0c52068723131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260924 12:58:31.925297 32490 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:31.925436 32490 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ecd8c666764cb88ea0c52068723131, State: Initialized, Role: FOLLOWER
I20260924 12:58:31.926275 32490 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ecd8c666764cb88ea0c52068723131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260924 12:58:31.926590 32490 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:31.926764 32490 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:31.926966 32490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:31.930115 32490 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ecd8c666764cb88ea0c52068723131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260924 12:58:31.930800 32490 leader_election.cc:302] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71ecd8c666764cb88ea0c52068723131; no voters:
I20260924 12:58:31.931567 32490 leader_election.cc:288] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:31.931936 32500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:31.933362 32500 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [term 1 LEADER]: Becoming Leader. State: Replica: 71ecd8c666764cb88ea0c52068723131, State: Running, Role: LEADER
I20260924 12:58:31.934058 32500 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ecd8c666764cb88ea0c52068723131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260924 12:58:31.934580 32490 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:31.938378 32501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71ecd8c666764cb88ea0c52068723131" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ecd8c666764cb88ea0c52068723131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } } }
I20260924 12:58:31.939028 32501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:31.938531 32502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71ecd8c666764cb88ea0c52068723131. Latest consensus state: current_term: 1 leader_uuid: "71ecd8c666764cb88ea0c52068723131" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ecd8c666764cb88ea0c52068723131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } } }
I20260924 12:58:31.939899 32502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:31.943372 32507 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:31.950223 32507 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:31.962241 32507 catalog_manager.cc:1347] Generated new cluster ID: efd56bb013c84da38455b913d82607b6
I20260924 12:58:31.962443 32507 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:31.976105 32507 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:31.976763 32507 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:31.984764 32507 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71ecd8c666764cb88ea0c52068723131: Generated new TSK 0
I20260924 12:58:31.986027 32507 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:31.995630 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32423
W20260924 12:58:31.997188 32485 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58229
W20260924 12:58:31.998185 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32423: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:31.998448 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 32423
2026-09-24T12:58:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2184 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:32 dist-test-slave-m9hg krb5kdc[32521](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:32 dist-test-slave-m9hg krb5kdc[32521](info): set up 2 sockets
Sep 24 12:58:32 dist-test-slave-m9hg krb5kdc[32521](info): commencing operation
krb5kdc: starting...
W20260924 12:58:33.201538 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:33 dist-test-slave-m9hg krb5kdc[32521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:33.537261 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45317
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:33.914166 32534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:33.914563 32534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:33.914760 32534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:33.922574 32534 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:33.922776 32534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:33.922894 32534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:33.923023 32534 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:33.923116 32534 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:33.933725 32534 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:33.935189 32534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:33.936757 32534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:33.950912 32539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:33.950959 32542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:33.951025 32540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:33.951850 32534 server_base.cc:1034] running on GCE node
I20260924 12:58:33.953243 32534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:33.955222 32534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:33.956630 32534 hybrid_clock.cc:648] HybridClock initialized: now 1790254713956486 us; error 80 us; skew 500 ppm
I20260924 12:58:33.957195 32534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:33 dist-test-slave-m9hg krb5kdc[32521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254713, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:33.962072 32534 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:33.964381 32534 webserver.cc:460] Webserver started at http://127.0.0.1:40257/ using document root <none> and password file <none>
I20260924 12:58:33.965329 32534 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:33.965473 32534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:33.965798 32534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:33.969990 32534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "cef01c1f95084b3a91853cf7c14236ce"
format_stamp: "Formatted at 2026-09-24 12:58:33 on dist-test-slave-m9hg"
server_key: "5e9b67764050bd9502fe722ad391e463"
server_key_iv: "0e56da582aa533e0fd29836ba35f6c6d"
server_key_version: "encryptionkey@0"
I20260924 12:58:33.971112 32534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "cef01c1f95084b3a91853cf7c14236ce"
format_stamp: "Formatted at 2026-09-24 12:58:33 on dist-test-slave-m9hg"
server_key: "5e9b67764050bd9502fe722ad391e463"
server_key_iv: "0e56da582aa533e0fd29836ba35f6c6d"
server_key_version: "encryptionkey@0"
I20260924 12:58:33.978196 32534 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260924 12:58:33.983651 32549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:33.985850 32534 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260924 12:58:33.986142 32534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "cef01c1f95084b3a91853cf7c14236ce"
format_stamp: "Formatted at 2026-09-24 12:58:33 on dist-test-slave-m9hg"
server_key: "5e9b67764050bd9502fe722ad391e463"
server_key_iv: "0e56da582aa533e0fd29836ba35f6c6d"
server_key_version: "encryptionkey@0"
I20260924 12:58:33.986418 32534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:34.007189 32534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:34.013027 32534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:34.013386 32534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:34.038115 32534 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45317
I20260924 12:58:34.038138 32600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45317 every 8 connection(s)
I20260924 12:58:34.040154 32534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:34.042816 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 32534
I20260924 12:58:34.043053 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:34.043602 11461 external_mini_cluster.cc:1428] Setting key 74b14d5c6a7a97bf28d45800f9bbce49
I20260924 12:58:34.045264 32601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:34.061653 32601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce: Bootstrap starting.
Sep 24 12:58:34 dist-test-slave-m9hg krb5kdc[32521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260924 12:58:34.065441 32601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:34.066952 32601 log.cc:824] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:34.071556 32601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce: No bootstrap required, opened a new log
I20260924 12:58:34.074934 32604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:34.046072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:59659 (local address 127.0.0.1:45317)
0924 12:58:34.047268 (+ 1196us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:34.047285 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:34.047347 (+ 62us) server_negotiation.cc:407] Connection header received
0924 12:58:34.049460 (+ 2113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:34.049502 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:34.050163 (+ 661us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:34.050652 (+ 489us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:34.052878 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:34.054640 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:34.056667 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:34.057599 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:34.057779 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:34.063967 (+ 6188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:34.063980 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:34.064000 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:34.064074 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:34.068563 (+ 4489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:34.070033 (+ 1470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:34.070043 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:34.070053 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:34.070327 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:34.070980 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:34.070986 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:34.070989 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:34.071804 (+ 815us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:34.072222 (+ 418us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:34.072927 (+ 705us) server_negotiation.cc:299] Negotiation successful
0924 12:58:34.073348 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":798,"thread_start_us":498,"threads_started":1}
I20260924 12:58:34.081172 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:34.082751 32601 raft_consensus.cc:348] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef01c1f95084b3a91853cf7c14236ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45317 } }
I20260924 12:58:34.083220 32601 raft_consensus.cc:374] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:34.083354 32601 raft_consensus.cc:729] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cef01c1f95084b3a91853cf7c14236ce, State: Initialized, Role: FOLLOWER
I20260924 12:58:34.084000 32601 consensus_queue.cc:260] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef01c1f95084b3a91853cf7c14236ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45317 } }
I20260924 12:58:34.084316 32601 raft_consensus.cc:388] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:34.084504 32601 raft_consensus.cc:482] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:34.084725 32601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:34.088075 32601 raft_consensus.cc:504] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef01c1f95084b3a91853cf7c14236ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45317 } }
I20260924 12:58:34.088752 32601 leader_election.cc:302] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cef01c1f95084b3a91853cf7c14236ce; no voters:
I20260924 12:58:34.089566 32601 leader_election.cc:288] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:34.089704 32611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:34.092494 32611 raft_consensus.cc:686] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [term 1 LEADER]: Becoming Leader. State: Replica: cef01c1f95084b3a91853cf7c14236ce, State: Running, Role: LEADER
I20260924 12:58:34.092877 32601 sys_catalog.cc:564] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:34.093343 32611 consensus_queue.cc:237] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef01c1f95084b3a91853cf7c14236ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45317 } }
I20260924 12:58:34.097739 32613 sys_catalog.cc:455] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader cef01c1f95084b3a91853cf7c14236ce. Latest consensus state: current_term: 1 leader_uuid: "cef01c1f95084b3a91853cf7c14236ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef01c1f95084b3a91853cf7c14236ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45317 } } }
I20260924 12:58:34.100229 32613 sys_catalog.cc:458] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:34.098520 32612 sys_catalog.cc:455] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cef01c1f95084b3a91853cf7c14236ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef01c1f95084b3a91853cf7c14236ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45317 } } }
I20260924 12:58:34.100649 32612 sys_catalog.cc:458] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:34.111572 32604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:34.087264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:36745 (local address 127.0.0.1:45317)
0924 12:58:34.087574 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:34.087584 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:34.088053 (+ 469us) server_negotiation.cc:407] Connection header received
0924 12:58:34.088378 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:34.088388 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:34.088472 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:34.088600 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:34.090639 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:34.091999 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:34.093944 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:34.094669 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:34.094844 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:34.099209 (+ 4365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:34.099215 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:34.099219 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:34.099271 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:34.103773 (+ 4502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:34.106123 (+ 2350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:34.106138 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:34.106145 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:34.106454 (+ 309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:34.107363 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:34.107371 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:34.107378 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:34.108033 (+ 655us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:34.108492 (+ 459us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:34.110440 (+ 1948us) server_negotiation.cc:299] Negotiation successful
0924 12:58:34.110795 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":104}
I20260924 12:58:34.114570 32621 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:34.121824 32621 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:34.134481 32621 catalog_manager.cc:1347] Generated new cluster ID: 44a8379c4f2f4299a4df698ca148af77
I20260924 12:58:34.134639 32621 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:34.159389 32621 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:34.161140 32621 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:34.168915 32621 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cef01c1f95084b3a91853cf7c14236ce: Generated new TSK 0
I20260924 12:58:34.169938 32621 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:34.188773 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32534
I20260924 12:58:34.191433 32596 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:34.290617 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 32534
W20260924 12:58:34.312835 32519 connection.cc:535] client connection to 127.0.0.1:45317 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45317): Connection reset by peer (error 104)
2026-09-24T12:58:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2291 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:34 dist-test-slave-m9hg krb5kdc[32633](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:34 dist-test-slave-m9hg krb5kdc[32633](info): set up 2 sockets
Sep 24 12:58:34 dist-test-slave-m9hg krb5kdc[32633](info): commencing operation
krb5kdc: starting...
W20260924 12:58:35.457378 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.003s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:35 dist-test-slave-m9hg krb5kdc[32633](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:35.809762 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46253
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46253
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:36.182397 32646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:36.182837 32646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:36.183010 32646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:36.191534 32646 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:36.191711 32646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:36.191831 32646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:36.191967 32646 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:36.192049 32646 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:36.203917 32646 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:36.205871 32646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:36.208114 32646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:36.225068 32654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:36.225265 32652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:36.225265 32651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:36.226279 32646 server_base.cc:1034] running on GCE node
I20260924 12:58:36.227178 32646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:36.229012 32646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:36.230297 32646 hybrid_clock.cc:648] HybridClock initialized: now 1790254716230245 us; error 62 us; skew 500 ppm
I20260924 12:58:36.230720 32646 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:36 dist-test-slave-m9hg krb5kdc[32633](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254716, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:36.234619 32646 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:36.236941 32646 webserver.cc:460] Webserver started at http://127.0.0.1:35279/ using document root <none> and password file <none>
I20260924 12:58:36.237790 32646 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:36.237908 32646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:36.238193 32646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:36.241595 32646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "8c6b06520bd1412bb86eb73ea6cd77a9"
format_stamp: "Formatted at 2026-09-24 12:58:36 on dist-test-slave-m9hg"
server_key: "5e167a3b0936e529a7bb6aff7b207ee5"
server_key_iv: "1b283b5687acc7b82164580a0ed7fda6"
server_key_version: "encryptionkey@0"
I20260924 12:58:36.242413 32646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "8c6b06520bd1412bb86eb73ea6cd77a9"
format_stamp: "Formatted at 2026-09-24 12:58:36 on dist-test-slave-m9hg"
server_key: "5e167a3b0936e529a7bb6aff7b207ee5"
server_key_iv: "1b283b5687acc7b82164580a0ed7fda6"
server_key_version: "encryptionkey@0"
I20260924 12:58:36.248739 32646 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260924 12:58:36.253279 32661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:36.255252 32646 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260924 12:58:36.255481 32646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "8c6b06520bd1412bb86eb73ea6cd77a9"
format_stamp: "Formatted at 2026-09-24 12:58:36 on dist-test-slave-m9hg"
server_key: "5e167a3b0936e529a7bb6aff7b207ee5"
server_key_iv: "1b283b5687acc7b82164580a0ed7fda6"
server_key_version: "encryptionkey@0"
I20260924 12:58:36.255704 32646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:36.301186 32646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:36.306303 32646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:36.306563 32646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:36.330549 32646 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46253
I20260924 12:58:36.330574 32712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46253 every 8 connection(s)
I20260924 12:58:36.332031 32646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:36.335796 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 32646
I20260924 12:58:36.336051 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:36.336724 11461 external_mini_cluster.cc:1428] Setting key 743c5011231ccf038d9140d5510a54cf
I20260924 12:58:36.337831 32713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:36.352201 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:36.339181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:37997 (local address 127.0.0.1:46253)
0924 12:58:36.340156 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:36.340171 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:36.340216 (+ 45us) server_negotiation.cc:407] Connection header received
0924 12:58:36.342189 (+ 1973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:36.342215 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:36.342722 (+ 507us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:36.343180 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:36.343806 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:36.345370 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:36.347034 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:36.347805 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:36.348039 (+ 234us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:36.349607 (+ 1568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:36.349616 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:36.349631 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:36.350266 (+ 635us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:36.350353 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:36.350378 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:36.350596 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:36.350893 (+ 297us) server_negotiation.cc:299] Negotiation successful
0924 12:58:36.351092 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":428,"threads_started":1}
I20260924 12:58:36.355309 32713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9: Bootstrap starting.
I20260924 12:58:36.357620 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:36.360394 32713 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:36.363559 32713 log.cc:824] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:36.368435 32713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9: No bootstrap required, opened a new log
I20260924 12:58:36.371601 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:36.363228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:35585 (local address 127.0.0.1:46253)
0924 12:58:36.363505 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:36.363513 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:36.363674 (+ 161us) server_negotiation.cc:407] Connection header received
0924 12:58:36.363837 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:36.363845 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:36.363982 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:36.364165 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:36.365141 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:36.366434 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:36.368182 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:36.368961 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:36.369168 (+ 207us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:36.370527 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:36.370534 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:36.370541 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:36.370577 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:36.370635 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:36.370658 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:36.370807 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:36.371082 (+ 275us) server_negotiation.cc:299] Negotiation successful
0924 12:58:36.371172 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":106}
I20260924 12:58:36.378515 32713 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c6b06520bd1412bb86eb73ea6cd77a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46253 } }
I20260924 12:58:36.379067 32713 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:36.379216 32713 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6b06520bd1412bb86eb73ea6cd77a9, State: Initialized, Role: FOLLOWER
I20260924 12:58:36.379959 32713 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c6b06520bd1412bb86eb73ea6cd77a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46253 } }
I20260924 12:58:36.380236 32713 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:36.380414 32713 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:36.380637 32713 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:36.383503 32713 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c6b06520bd1412bb86eb73ea6cd77a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46253 } }
I20260924 12:58:36.384217 32713 leader_election.cc:302] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c6b06520bd1412bb86eb73ea6cd77a9; no voters:
I20260924 12:58:36.385113 32713 leader_election.cc:288] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:36.385356 32723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:36.386363 32723 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [term 1 LEADER]: Becoming Leader. State: Replica: 8c6b06520bd1412bb86eb73ea6cd77a9, State: Running, Role: LEADER
I20260924 12:58:36.386999 32723 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c6b06520bd1412bb86eb73ea6cd77a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46253 } }
I20260924 12:58:36.387934 32713 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:36.390774 32724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c6b06520bd1412bb86eb73ea6cd77a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c6b06520bd1412bb86eb73ea6cd77a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46253 } } }
I20260924 12:58:36.391515 32724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:36.396140 32725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c6b06520bd1412bb86eb73ea6cd77a9. Latest consensus state: current_term: 1 leader_uuid: "8c6b06520bd1412bb86eb73ea6cd77a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c6b06520bd1412bb86eb73ea6cd77a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46253 } } }
I20260924 12:58:36.396727 32725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:36.401501 32729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:36.407137 32729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:36.416940 32729 catalog_manager.cc:1347] Generated new cluster ID: 4c60b7ee0ea14352bb8886c961d56b62
I20260924 12:58:36.417121 32729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:36.447866 32729 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:36.449987 32729 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:36.465636 32729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c6b06520bd1412bb86eb73ea6cd77a9: Generated new TSK 0
I20260924 12:58:36.466666 32729 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:36.484452 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32646
W20260924 12:58:36.486112 32708 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.214:37997
W20260924 12:58:36.487170 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32646: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:36.487396 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 32646
W20260924 12:58:36.505575 32631 connection.cc:535] client connection to 127.0.0.1:46253 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46253): Connection reset by peer (error 104)
2026-09-24T12:58:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2192 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:36 dist-test-slave-m9hg krb5kdc[32744](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:36 dist-test-slave-m9hg krb5kdc[32744](info): set up 2 sockets
Sep 24 12:58:36 dist-test-slave-m9hg krb5kdc[32744](info): commencing operation
krb5kdc: starting...
W20260924 12:58:37.673573 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.003s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:37 dist-test-slave-m9hg krb5kdc[32744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:38.019186 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36649
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:38.436993 32757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:38.437418 32757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:38.437636 32757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:38.446213 32757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:38.446383 32757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:38.446484 32757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:38.446614 32757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:38.446689 32757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:38.458829 32757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:38.460772 32757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:38.462560 32757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:38.478344 32763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:38.478188 32762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:38.478377 32765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:38.479444 32757 server_base.cc:1034] running on GCE node
I20260924 12:58:38.480633 32757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:38.482388 32757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:38.483659 32757 hybrid_clock.cc:648] HybridClock initialized: now 1790254718483599 us; error 57 us; skew 500 ppm
I20260924 12:58:38.484129 32757 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:38 dist-test-slave-m9hg krb5kdc[32744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254718, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:38.488152 32757 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:38.490200 32757 webserver.cc:460] Webserver started at http://127.0.0.1:36163/ using document root <none> and password file <none>
I20260924 12:58:38.491065 32757 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:38.491211 32757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:38.491592 32757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:38.494913 32757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "3751ac3f864f488287e2331a85619484"
format_stamp: "Formatted at 2026-09-24 12:58:38 on dist-test-slave-m9hg"
server_key: "79d2fae40190d0b49e0963bc8754ee10"
server_key_iv: "8fd85202b3cc299fee8d6464301f664d"
server_key_version: "encryptionkey@0"
I20260924 12:58:38.495759 32757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "3751ac3f864f488287e2331a85619484"
format_stamp: "Formatted at 2026-09-24 12:58:38 on dist-test-slave-m9hg"
server_key: "79d2fae40190d0b49e0963bc8754ee10"
server_key_iv: "8fd85202b3cc299fee8d6464301f664d"
server_key_version: "encryptionkey@0"
I20260924 12:58:38.501917 32757 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260924 12:58:38.506356 304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:38.508368 32757 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260924 12:58:38.508607 32757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "3751ac3f864f488287e2331a85619484"
format_stamp: "Formatted at 2026-09-24 12:58:38 on dist-test-slave-m9hg"
server_key: "79d2fae40190d0b49e0963bc8754ee10"
server_key_iv: "8fd85202b3cc299fee8d6464301f664d"
server_key_version: "encryptionkey@0"
I20260924 12:58:38.508829 32757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:38.515501 32757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:38.520385 32757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:38.520677 32757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:38.543804 32757 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36649
I20260924 12:58:38.543960 355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36649 every 8 connection(s)
I20260924 12:58:38.545470 32757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:38.550868 356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:38.552250 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 32757
I20260924 12:58:38.552554 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:38.553105 11461 external_mini_cluster.cc:1428] Setting key 53f8d0ce2bbafa9eb4234996ad7ec43a
I20260924 12:58:38.564788 359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:38.555510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:47597 (local address 127.0.0.1:36649)
0924 12:58:38.556639 (+ 1129us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:38.556670 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:38.556743 (+ 73us) server_negotiation.cc:407] Connection header received
0924 12:58:38.559351 (+ 2608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:38.559398 (+ 47us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:38.560108 (+ 710us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:38.560801 (+ 693us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:38.562004 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:38.562014 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:38.562052 (+ 38us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:38.562072 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:38.562307 (+ 235us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:38.562370 (+ 63us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:38.562686 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:38.562845 (+ 159us) server_negotiation.cc:299] Negotiation successful
0924 12:58:38.563140 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":796,"thread_start_us":481,"threads_started":1}
I20260924 12:58:38.569331 356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484: Bootstrap starting.
I20260924 12:58:38.569679 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:38.574435 356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:38.576151 356 log.cc:824] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:38.579788 359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:38.576664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:59991 (local address 127.0.0.1:36649)
0924 12:58:38.576903 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:38.576913 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:38.577376 (+ 463us) server_negotiation.cc:407] Connection header received
0924 12:58:38.577584 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:38.577593 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:38.577678 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:38.577852 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:38.578993 (+ 1141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:38.579000 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:38.579004 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:38.579028 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:38.579091 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:38.579113 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:38.579284 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:38.579405 (+ 121us) server_negotiation.cc:299] Negotiation successful
0924 12:58:38.579486 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260924 12:58:38.580540 356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484: No bootstrap required, opened a new log
I20260924 12:58:38.590087 356 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3751ac3f864f488287e2331a85619484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36649 } }
I20260924 12:58:38.590724 356 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:38.590864 356 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3751ac3f864f488287e2331a85619484, State: Initialized, Role: FOLLOWER
I20260924 12:58:38.591807 356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3751ac3f864f488287e2331a85619484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36649 } }
I20260924 12:58:38.592140 356 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:38.592342 356 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:38.592579 356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:38.596030 356 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3751ac3f864f488287e2331a85619484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36649 } }
I20260924 12:58:38.597078 356 leader_election.cc:302] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3751ac3f864f488287e2331a85619484; no voters:
I20260924 12:58:38.597999 356 leader_election.cc:288] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:38.598186 366 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:38.599825 366 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [term 1 LEADER]: Becoming Leader. State: Replica: 3751ac3f864f488287e2331a85619484, State: Running, Role: LEADER
I20260924 12:58:38.600715 366 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3751ac3f864f488287e2331a85619484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36649 } }
I20260924 12:58:38.601554 356 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:38.604024 368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3751ac3f864f488287e2331a85619484. Latest consensus state: current_term: 1 leader_uuid: "3751ac3f864f488287e2331a85619484" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3751ac3f864f488287e2331a85619484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36649 } } }
I20260924 12:58:38.604566 368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:38.607446 367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3751ac3f864f488287e2331a85619484" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3751ac3f864f488287e2331a85619484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36649 } } }
I20260924 12:58:38.608180 367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:38.611127 372 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:38.618068 372 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:38.631785 372 catalog_manager.cc:1347] Generated new cluster ID: dd8d38c1a29246eea41979360945035d
I20260924 12:58:38.631994 372 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:38.645007 372 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:38.645782 372 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:38.658989 372 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3751ac3f864f488287e2331a85619484: Generated new TSK 0
I20260924 12:58:38.660368 372 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:38.672410 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32757
W20260924 12:58:38.674508 351 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.214:47597
W20260924 12:58:38.675539 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 32757: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:38.675742 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 32757
2026-09-24T12:58:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2192 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:38 dist-test-slave-m9hg krb5kdc[387](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:38 dist-test-slave-m9hg krb5kdc[387](info): set up 2 sockets
Sep 24 12:58:38 dist-test-slave-m9hg krb5kdc[387](info): commencing operation
krb5kdc: starting...
W20260924 12:58:39.901937 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.007s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:40 dist-test-slave-m9hg krb5kdc[387](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:40.231766 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34173
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34173
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:40.680083 400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:40.680650 400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:40.680852 400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:40.689538 400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:40.689704 400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:40.689806 400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:40.689935 400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:40.690016 400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:40.703310 400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34173
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:40.705302 400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:40.707106 400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:40.722730 406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:40.723193 409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:40.723166 407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:40.724869 400 server_base.cc:1034] running on GCE node
I20260924 12:58:40.726109 400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:40.728216 400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:40.729606 400 hybrid_clock.cc:648] HybridClock initialized: now 1790254720729542 us; error 49 us; skew 500 ppm
I20260924 12:58:40.730167 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:40 dist-test-slave-m9hg krb5kdc[387](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254720, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:40.734591 400 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:40.737007 400 webserver.cc:460] Webserver started at http://127.0.0.1:43971/ using document root <none> and password file <none>
I20260924 12:58:40.738022 400 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:40.738232 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:40.738644 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:40.742895 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "cc27501417904a4cb719003cc4ae6f58"
format_stamp: "Formatted at 2026-09-24 12:58:40 on dist-test-slave-m9hg"
server_key: "fd4d5547cee9f3e991d3eafe4838df52"
server_key_iv: "30d8e223dea7742115947f6118784598"
server_key_version: "encryptionkey@0"
I20260924 12:58:40.744059 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "cc27501417904a4cb719003cc4ae6f58"
format_stamp: "Formatted at 2026-09-24 12:58:40 on dist-test-slave-m9hg"
server_key: "fd4d5547cee9f3e991d3eafe4838df52"
server_key_iv: "30d8e223dea7742115947f6118784598"
server_key_version: "encryptionkey@0"
I20260924 12:58:40.751715 400 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260924 12:58:40.757125 416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:40.759274 400 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 12:58:40.759601 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "cc27501417904a4cb719003cc4ae6f58"
format_stamp: "Formatted at 2026-09-24 12:58:40 on dist-test-slave-m9hg"
server_key: "fd4d5547cee9f3e991d3eafe4838df52"
server_key_iv: "30d8e223dea7742115947f6118784598"
server_key_version: "encryptionkey@0"
I20260924 12:58:40.759915 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:40.778820 400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:40.784649 400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:40.785036 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:40.809437 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34173
I20260924 12:58:40.809481 467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34173 every 8 connection(s)
I20260924 12:58:40.811285 400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:40.815842 468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:40.817376 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 400
I20260924 12:58:40.817577 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:40.818156 11461 external_mini_cluster.cc:1428] Setting key d7677f6de4c3d9c3bbf9c0d46212f578
I20260924 12:58:40.829879 468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58: Bootstrap starting.
I20260924 12:58:40.834126 468 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:40.835671 468 log.cc:824] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58: Log is configured to *not* fsync() on all Append() calls
Sep 24 12:58:40 dist-test-slave-m9hg krb5kdc[387](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260924 12:58:40.840147 468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58: No bootstrap required, opened a new log
I20260924 12:58:40.850270 471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:40.820711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:55059 (local address 127.0.0.1:34173)
0924 12:58:40.821856 (+ 1145us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:40.821872 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:40.821933 (+ 61us) server_negotiation.cc:407] Connection header received
0924 12:58:40.824139 (+ 2206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:40.824171 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:40.824856 (+ 685us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:40.825313 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:40.827361 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:40.829259 (+ 1898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:40.831233 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:40.832248 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:40.832551 (+ 303us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:40.839130 (+ 6579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:40.839143 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:40.839166 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:40.839227 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:40.843815 (+ 4588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:40.845348 (+ 1533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:40.845358 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:40.845368 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:40.845626 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:40.846296 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:40.846300 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:40.846302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:40.847168 (+ 866us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:40.847474 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:40.848214 (+ 740us) server_negotiation.cc:299] Negotiation successful
0924 12:58:40.848724 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":850,"thread_start_us":549,"threads_started":1}
I20260924 12:58:40.851605 468 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc27501417904a4cb719003cc4ae6f58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34173 } }
I20260924 12:58:40.852129 468 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:40.852367 468 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc27501417904a4cb719003cc4ae6f58, State: Initialized, Role: FOLLOWER
I20260924 12:58:40.853088 468 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc27501417904a4cb719003cc4ae6f58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34173 } }
I20260924 12:58:40.853420 468 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:40.853624 468 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:40.853821 468 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:40.855903 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:40.857020 468 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc27501417904a4cb719003cc4ae6f58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34173 } }
I20260924 12:58:40.857632 468 leader_election.cc:302] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc27501417904a4cb719003cc4ae6f58; no voters:
I20260924 12:58:40.858425 468 leader_election.cc:288] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:40.858714 473 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:40.860379 473 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [term 1 LEADER]: Becoming Leader. State: Replica: cc27501417904a4cb719003cc4ae6f58, State: Running, Role: LEADER
I20260924 12:58:40.861186 468 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:40.861433 473 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc27501417904a4cb719003cc4ae6f58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34173 } }
I20260924 12:58:40.870891 477 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc27501417904a4cb719003cc4ae6f58. Latest consensus state: current_term: 1 leader_uuid: "cc27501417904a4cb719003cc4ae6f58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc27501417904a4cb719003cc4ae6f58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34173 } } }
I20260924 12:58:40.871546 477 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:40.872577 474 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc27501417904a4cb719003cc4ae6f58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc27501417904a4cb719003cc4ae6f58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34173 } } }
I20260924 12:58:40.873020 474 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:40.874922 485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:40.882911 485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:40.895710 471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:40.863443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:38761 (local address 127.0.0.1:34173)
0924 12:58:40.863744 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:40.863756 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:40.874153 (+ 10397us) server_negotiation.cc:407] Connection header received
0924 12:58:40.874543 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:40.874550 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:40.874644 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:40.874713 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:40.876844 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:40.878086 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:40.880421 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:40.881400 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:40.881579 (+ 179us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:40.885968 (+ 4389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:40.885975 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:40.885979 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:40.886029 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:40.890047 (+ 4018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:40.891135 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:40.891140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:40.891142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:40.891367 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:40.892328 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:40.892339 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:40.892343 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:40.893058 (+ 715us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:40.893433 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:40.894967 (+ 1534us) server_negotiation.cc:299] Negotiation successful
0924 12:58:40.895242 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260924 12:58:40.895856 485 catalog_manager.cc:1347] Generated new cluster ID: cc6e2ef1f3ad4c4ba59c37cd869056e6
I20260924 12:58:40.896080 485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:40.924139 485 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:40.926539 485 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:40.935525 485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc27501417904a4cb719003cc4ae6f58: Generated new TSK 0
I20260924 12:58:40.936870 485 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:40.945382 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 400
I20260924 12:58:40.947135 463 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:41.054704 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 400
W20260924 12:58:41.074900 385 connection.cc:535] client connection to 127.0.0.1:34173 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34173): Connection reset by peer (error 104)
2026-09-24T12:58:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2376 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:41 dist-test-slave-m9hg krb5kdc[501](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:41 dist-test-slave-m9hg krb5kdc[501](info): set up 2 sockets
Sep 24 12:58:41 dist-test-slave-m9hg krb5kdc[501](info): commencing operation
krb5kdc: starting...
W20260924 12:58:42.225345 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.003s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:42 dist-test-slave-m9hg krb5kdc[501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:42.553059 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40067
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:42.993521 514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:42.994010 514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:42.994215 514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:43.002908 514 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:43.003144 514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:43.003279 514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:43.003400 514 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:43.003485 514 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:43.015105 514 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40067
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:43.017066 514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:43.018785 514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:43.033354 519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:43.033402 520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:43.033727 522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:43.035058 514 server_base.cc:1034] running on GCE node
I20260924 12:58:43.036033 514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:43.037774 514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:43.039053 514 hybrid_clock.cc:648] HybridClock initialized: now 1790254723039001 us; error 63 us; skew 500 ppm
I20260924 12:58:43.039522 514 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:43 dist-test-slave-m9hg krb5kdc[501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254723, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:43.047757 514 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:43.049981 514 webserver.cc:460] Webserver started at http://127.0.0.1:36187/ using document root <none> and password file <none>
I20260924 12:58:43.050760 514 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:43.050874 514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:43.051132 514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:43.054352 514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "4e51d8867dfc4918a61802ef73c829de"
format_stamp: "Formatted at 2026-09-24 12:58:43 on dist-test-slave-m9hg"
server_key: "065f79c1f904825a2d0f3d638719f62f"
server_key_iv: "4197e36c0f3c59f794887a7ee06896c9"
server_key_version: "encryptionkey@0"
I20260924 12:58:43.055151 514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "4e51d8867dfc4918a61802ef73c829de"
format_stamp: "Formatted at 2026-09-24 12:58:43 on dist-test-slave-m9hg"
server_key: "065f79c1f904825a2d0f3d638719f62f"
server_key_iv: "4197e36c0f3c59f794887a7ee06896c9"
server_key_version: "encryptionkey@0"
I20260924 12:58:43.061697 514 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260924 12:58:43.066262 529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:43.068408 514 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.004s
I20260924 12:58:43.068634 514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "4e51d8867dfc4918a61802ef73c829de"
format_stamp: "Formatted at 2026-09-24 12:58:43 on dist-test-slave-m9hg"
server_key: "065f79c1f904825a2d0f3d638719f62f"
server_key_iv: "4197e36c0f3c59f794887a7ee06896c9"
server_key_version: "encryptionkey@0"
I20260924 12:58:43.068866 514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:43.109067 514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:43.114261 514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:43.114549 514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:43.138262 514 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40067
I20260924 12:58:43.138365 580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40067 every 8 connection(s)
I20260924 12:58:43.139907 514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:43.145125 581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:43.148032 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 514
I20260924 12:58:43.148326 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:43.149009 11461 external_mini_cluster.cc:1428] Setting key 2c7553ebd32ea87007251749ad33dc05
I20260924 12:58:43.160440 581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de: Bootstrap starting.
I20260924 12:58:43.164505 584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:43.151582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:41453 (local address 127.0.0.1:40067)
0924 12:58:43.152810 (+ 1228us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:43.152827 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:43.152888 (+ 61us) server_negotiation.cc:407] Connection header received
0924 12:58:43.154984 (+ 2096us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:43.155012 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:43.155516 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:43.155985 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:43.156648 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:43.158087 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:43.159442 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:43.160154 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:43.160393 (+ 239us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:43.161868 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:43.161875 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:43.161893 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:43.162583 (+ 690us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:43.162669 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:43.162700 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:43.162886 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:43.163169 (+ 283us) server_negotiation.cc:299] Negotiation successful
0924 12:58:43.163346 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":913,"thread_start_us":524,"threads_started":1}
I20260924 12:58:43.165120 581 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:43.166828 581 log.cc:824] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:43.169973 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:43.171134 581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de: No bootstrap required, opened a new log
I20260924 12:58:43.182471 581 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e51d8867dfc4918a61802ef73c829de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40067 } }
I20260924 12:58:43.183180 581 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:43.183342 581 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e51d8867dfc4918a61802ef73c829de, State: Initialized, Role: FOLLOWER
I20260924 12:58:43.183612 584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:43.175385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:39607 (local address 127.0.0.1:40067)
0924 12:58:43.175644 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:43.175650 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:43.176052 (+ 402us) server_negotiation.cc:407] Connection header received
0924 12:58:43.176414 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:43.176419 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:43.176510 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:43.176627 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:43.177399 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:43.178213 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:43.180412 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:43.180972 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:43.181078 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:43.182587 (+ 1509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:43.182592 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:43.182596 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:43.182615 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:43.182658 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:43.182674 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:43.182765 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:43.183008 (+ 243us) server_negotiation.cc:299] Negotiation successful
0924 12:58:43.183093 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260924 12:58:43.184496 581 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e51d8867dfc4918a61802ef73c829de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40067 } }
I20260924 12:58:43.184907 581 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:43.185071 581 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:43.185290 581 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:43.188097 581 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e51d8867dfc4918a61802ef73c829de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40067 } }
I20260924 12:58:43.188838 581 leader_election.cc:302] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e51d8867dfc4918a61802ef73c829de; no voters:
I20260924 12:58:43.189565 581 leader_election.cc:288] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:43.189803 591 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:43.190737 591 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [term 1 LEADER]: Becoming Leader. State: Replica: 4e51d8867dfc4918a61802ef73c829de, State: Running, Role: LEADER
I20260924 12:58:43.191409 591 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e51d8867dfc4918a61802ef73c829de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40067 } }
I20260924 12:58:43.192561 581 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:43.195225 593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e51d8867dfc4918a61802ef73c829de. Latest consensus state: current_term: 1 leader_uuid: "4e51d8867dfc4918a61802ef73c829de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e51d8867dfc4918a61802ef73c829de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40067 } } }
I20260924 12:58:43.195034 592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e51d8867dfc4918a61802ef73c829de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e51d8867dfc4918a61802ef73c829de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40067 } } }
I20260924 12:58:43.195638 592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:43.195636 593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de [sys.catalog]: This master's current role is: LEADER
W20260924 12:58:43.206372 607 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 12:58:43.206579 607 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 12:58:43.206787 598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:43.208914 598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:43.221005 598 catalog_manager.cc:1347] Generated new cluster ID: 0505e124694f4c41a0f637f77a714867
I20260924 12:58:43.221189 598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:43.240873 598 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:43.242993 598 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:43.268508 598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e51d8867dfc4918a61802ef73c829de: Generated new TSK 0
I20260924 12:58:43.269917 598 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:43.287887 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 514
W20260924 12:58:43.289650 576 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.214:41453
W20260924 12:58:43.290688 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 514: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:43.290951 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 514
W20260924 12:58:43.312616 499 connection.cc:535] client connection to 127.0.0.1:40067 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40067): Connection reset by peer (error 104)
2026-09-24T12:58:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2237 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:43 dist-test-slave-m9hg krb5kdc[612](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:43 dist-test-slave-m9hg krb5kdc[612](info): set up 2 sockets
Sep 24 12:58:43 dist-test-slave-m9hg krb5kdc[612](info): commencing operation
krb5kdc: starting...
W20260924 12:58:44.429623 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.002s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:44 dist-test-slave-m9hg krb5kdc[612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 12:58:44.760178 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39579
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:45.195873 625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:45.196327 625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:45.196548 625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:45.205159 625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:45.205324 625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:45.205440 625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:45.205571 625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:45.205641 625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:45.217402 625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39579
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:45.219218 625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:45.220949 625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:45.236204 633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:45.236155 631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:45.236207 630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:45.237720 625 server_base.cc:1034] running on GCE node
I20260924 12:58:45.238715 625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:45.240582 625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:45.241927 625 hybrid_clock.cc:648] HybridClock initialized: now 1790254725241843 us; error 88 us; skew 500 ppm
I20260924 12:58:45.242373 625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:45 dist-test-slave-m9hg krb5kdc[612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254725, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:45.246030 625 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 12:58:45.247877 625 webserver.cc:460] Webserver started at http://127.0.0.1:42717/ using document root <none> and password file <none>
I20260924 12:58:45.248687 625 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:45.248804 625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:45.249063 625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:45.252349 625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "da0ec07972764463bc50b7ab9472134a"
format_stamp: "Formatted at 2026-09-24 12:58:45 on dist-test-slave-m9hg"
server_key: "5bb95aa4403c0b682e4fd0b0ad919f60"
server_key_iv: "ab54f2d1b1f5dd74898c0e40665597b1"
server_key_version: "encryptionkey@0"
I20260924 12:58:45.253237 625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "da0ec07972764463bc50b7ab9472134a"
format_stamp: "Formatted at 2026-09-24 12:58:45 on dist-test-slave-m9hg"
server_key: "5bb95aa4403c0b682e4fd0b0ad919f60"
server_key_iv: "ab54f2d1b1f5dd74898c0e40665597b1"
server_key_version: "encryptionkey@0"
I20260924 12:58:45.259614 625 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.006s
I20260924 12:58:45.264102 640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:45.266125 625 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260924 12:58:45.266381 625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "da0ec07972764463bc50b7ab9472134a"
format_stamp: "Formatted at 2026-09-24 12:58:45 on dist-test-slave-m9hg"
server_key: "5bb95aa4403c0b682e4fd0b0ad919f60"
server_key_iv: "ab54f2d1b1f5dd74898c0e40665597b1"
server_key_version: "encryptionkey@0"
I20260924 12:58:45.266611 625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:45.273237 625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:45.278023 625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:45.278376 625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:45.302278 625 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39579
I20260924 12:58:45.302421 691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39579 every 8 connection(s)
I20260924 12:58:45.304068 625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:45.304486 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 625
I20260924 12:58:45.304719 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:45.305313 11461 external_mini_cluster.cc:1428] Setting key 7193708e6a1621420465fa9a87bbb54a
I20260924 12:58:45.309376 692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:45.316156 695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:45.307915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:59951 (local address 127.0.0.1:39579)
0924 12:58:45.309071 (+ 1156us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:45.309088 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:45.309151 (+ 63us) server_negotiation.cc:407] Connection header received
0924 12:58:45.311424 (+ 2273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:45.311459 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:45.311989 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:45.312588 (+ 599us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:45.313982 (+ 1394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:45.313990 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:45.314012 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:45.314031 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:45.314136 (+ 105us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:45.314161 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:45.314396 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:45.314532 (+ 136us) server_negotiation.cc:299] Negotiation successful
0924 12:58:45.314851 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":864,"thread_start_us":576,"threads_started":1}
I20260924 12:58:45.322181 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:45.324810 692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a: Bootstrap starting.
I20260924 12:58:45.329684 692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:45.331207 692 log.cc:824] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:45.332933 695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:45.329325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:52659 (local address 127.0.0.1:39579)
0924 12:58:45.329581 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:45.329588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:45.329977 (+ 389us) server_negotiation.cc:407] Connection header received
0924 12:58:45.330176 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:45.330181 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:45.330268 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:45.330407 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:45.331670 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:45.331675 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:45.331679 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:45.331701 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:45.331976 (+ 275us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:45.332023 (+ 47us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:45.332228 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:45.332449 (+ 221us) server_negotiation.cc:299] Negotiation successful
0924 12:58:45.332550 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260924 12:58:45.335359 692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a: No bootstrap required, opened a new log
I20260924 12:58:45.343602 692 raft_consensus.cc:348] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0ec07972764463bc50b7ab9472134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39579 } }
I20260924 12:58:45.344053 692 raft_consensus.cc:374] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:45.344158 692 raft_consensus.cc:729] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0ec07972764463bc50b7ab9472134a, State: Initialized, Role: FOLLOWER
I20260924 12:58:45.344797 692 consensus_queue.cc:260] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0ec07972764463bc50b7ab9472134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39579 } }
I20260924 12:58:45.345053 692 raft_consensus.cc:388] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:45.345206 692 raft_consensus.cc:482] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:45.345393 692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:45.347733 692 raft_consensus.cc:504] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0ec07972764463bc50b7ab9472134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39579 } }
I20260924 12:58:45.348379 692 leader_election.cc:302] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da0ec07972764463bc50b7ab9472134a; no voters:
I20260924 12:58:45.349248 692 leader_election.cc:288] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:45.349478 702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:45.350454 702 raft_consensus.cc:686] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [term 1 LEADER]: Becoming Leader. State: Replica: da0ec07972764463bc50b7ab9472134a, State: Running, Role: LEADER
I20260924 12:58:45.351217 702 consensus_queue.cc:237] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0ec07972764463bc50b7ab9472134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39579 } }
I20260924 12:58:45.351840 692 sys_catalog.cc:564] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:45.355100 703 sys_catalog.cc:455] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da0ec07972764463bc50b7ab9472134a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0ec07972764463bc50b7ab9472134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39579 } } }
I20260924 12:58:45.355728 703 sys_catalog.cc:458] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:45.358376 704 sys_catalog.cc:455] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [sys.catalog]: SysCatalogTable state changed. Reason: New leader da0ec07972764463bc50b7ab9472134a. Latest consensus state: current_term: 1 leader_uuid: "da0ec07972764463bc50b7ab9472134a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0ec07972764463bc50b7ab9472134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39579 } } }
I20260924 12:58:45.358738 704 sys_catalog.cc:458] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:45.358983 710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:45.366319 710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:45.379153 710 catalog_manager.cc:1347] Generated new cluster ID: 5485580bdc784c70bc8b793d5f735587
I20260924 12:58:45.379318 710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:45.403759 710 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:45.404446 710 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:45.429837 710 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da0ec07972764463bc50b7ab9472134a: Generated new TSK 0
I20260924 12:58:45.431119 710 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:45.444159 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 625
W20260924 12:58:45.445730 687 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.214:59951
W20260924 12:58:45.446771 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 625: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:45.446992 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 625
2026-09-24T12:58:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2152 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:45 dist-test-slave-m9hg krb5kdc[723](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:45 dist-test-slave-m9hg krb5kdc[723](info): set up 2 sockets
Sep 24 12:58:45 dist-test-slave-m9hg krb5kdc[723](info): commencing operation
krb5kdc: starting...
W20260924 12:58:46.634099 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.002s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:46 dist-test-slave-m9hg krb5kdc[723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:58:46.956964 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:35441
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:35749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:35441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:47.322814 736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:47.323239 736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:47.323350 736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:47.332211 736 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:47.332438 736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:47.332495 736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:47.332571 736 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:47.332624 736 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:47.344383 736 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:35749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:35441
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:35441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:47.346151 736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:47.347838 736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:47.363083 741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:47.363270 744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:47.363314 742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:47.364182 736 server_base.cc:1034] running on GCE node
I20260924 12:58:47.365408 736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:47.367461 736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:47.368736 736 hybrid_clock.cc:648] HybridClock initialized: now 1790254727368670 us; error 51 us; skew 500 ppm
I20260924 12:58:47.369184 736 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:47 dist-test-slave-m9hg krb5kdc[723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254727, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:47.373718 736 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:58:47.375803 736 webserver.cc:460] Webserver started at http://127.11.49.126:35079/ using document root <none> and password file <none>
I20260924 12:58:47.376653 736 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:47.376781 736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:47.377061 736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:47.380443 736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "05248596b5fa4e5d9450511dd013e1ff"
format_stamp: "Formatted at 2026-09-24 12:58:47 on dist-test-slave-m9hg"
server_key: "bfac678d4a9a939b0388ab34e83ce9a0"
server_key_iv: "7b5d0d2980264c6117185784443cbcce"
server_key_version: "encryptionkey@0"
I20260924 12:58:47.381249 736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "05248596b5fa4e5d9450511dd013e1ff"
format_stamp: "Formatted at 2026-09-24 12:58:47 on dist-test-slave-m9hg"
server_key: "bfac678d4a9a939b0388ab34e83ce9a0"
server_key_iv: "7b5d0d2980264c6117185784443cbcce"
server_key_version: "encryptionkey@0"
I20260924 12:58:47.387485 736 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260924 12:58:47.391808 751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:47.393633 736 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:58:47.393827 736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "05248596b5fa4e5d9450511dd013e1ff"
format_stamp: "Formatted at 2026-09-24 12:58:47 on dist-test-slave-m9hg"
server_key: "bfac678d4a9a939b0388ab34e83ce9a0"
server_key_iv: "7b5d0d2980264c6117185784443cbcce"
server_key_version: "encryptionkey@0"
I20260924 12:58:47.394016 736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:47.411164 736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:47.416057 736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:47.416436 736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:47.438339 736 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:35441
I20260924 12:58:47.438467 802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:35441 every 8 connection(s)
I20260924 12:58:47.439893 736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:47.441578 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 736
I20260924 12:58:47.441772 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:47.442348 11461 external_mini_cluster.cc:1428] Setting key 95864da760b0b9b129a2811ec216c38a
I20260924 12:58:47.446738 803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 24 12:58:47 dist-test-slave-m9hg krb5kdc[723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:58:47.466758 803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff: Bootstrap starting.
I20260924 12:58:47.472210 803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:47.474095 803 log.cc:824] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:47.476370 806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:47.445116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50933 (local address 127.11.49.126:35441)
0924 12:58:47.446354 (+ 1238us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:47.446378 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:47.446433 (+ 55us) server_negotiation.cc:407] Connection header received
0924 12:58:47.448526 (+ 2093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:47.448555 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:47.449071 (+ 516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:47.449478 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:47.452376 (+ 2898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:47.453993 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:47.456645 (+ 2652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:47.457489 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:47.457671 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:47.465006 (+ 7335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:47.465025 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:47.465054 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:47.465132 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:47.469953 (+ 4821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:47.471197 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:47.471209 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:47.471219 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:47.471500 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:47.472194 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:47.472201 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:47.472205 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:47.473194 (+ 989us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:47.473582 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:47.474181 (+ 599us) server_negotiation.cc:299] Negotiation successful
0924 12:58:47.474651 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":975,"thread_start_us":619,"threads_started":1}
I20260924 12:58:47.478742 803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff: No bootstrap required, opened a new log
I20260924 12:58:47.481837 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:47.489872 803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05248596b5fa4e5d9450511dd013e1ff" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35441 } }
I20260924 12:58:47.490566 803 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:47.490746 803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05248596b5fa4e5d9450511dd013e1ff, State: Initialized, Role: FOLLOWER
I20260924 12:58:47.491689 803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05248596b5fa4e5d9450511dd013e1ff" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35441 } }
I20260924 12:58:47.492111 803 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:47.492338 803 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:47.492623 803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:47.497267 803 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05248596b5fa4e5d9450511dd013e1ff" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35441 } }
I20260924 12:58:47.498377 803 leader_election.cc:302] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05248596b5fa4e5d9450511dd013e1ff; no voters:
I20260924 12:58:47.499285 803 leader_election.cc:288] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:47.499526 813 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:47.503314 803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:47.505066 813 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [term 1 LEADER]: Becoming Leader. State: Replica: 05248596b5fa4e5d9450511dd013e1ff, State: Running, Role: LEADER
I20260924 12:58:47.506058 813 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05248596b5fa4e5d9450511dd013e1ff" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35441 } }
I20260924 12:58:47.509482 815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05248596b5fa4e5d9450511dd013e1ff. Latest consensus state: current_term: 1 leader_uuid: "05248596b5fa4e5d9450511dd013e1ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05248596b5fa4e5d9450511dd013e1ff" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35441 } } }
I20260924 12:58:47.509949 815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:47.512560 814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05248596b5fa4e5d9450511dd013e1ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05248596b5fa4e5d9450511dd013e1ff" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35441 } } }
I20260924 12:58:47.514967 814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:47.517206 806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:47.487284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54683 (local address 127.11.49.126:35441)
0924 12:58:47.487542 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:47.487557 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:47.487988 (+ 431us) server_negotiation.cc:407] Connection header received
0924 12:58:47.488240 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:47.488244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:47.488370 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:47.488489 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:47.490128 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:47.491221 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:47.493829 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:47.494384 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:47.494526 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:47.499091 (+ 4565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:47.499101 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:47.499108 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:47.499167 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:47.505298 (+ 6131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:47.507409 (+ 2111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:47.507416 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:47.507420 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:47.507705 (+ 285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:47.508781 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:47.508787 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:47.508791 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:47.509354 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:47.509748 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:47.512867 (+ 3119us) server_negotiation.cc:299] Negotiation successful
0924 12:58:47.513307 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260924 12:58:47.522936 823 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:47.532094 823 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:47.543888 823 catalog_manager.cc:1347] Generated new cluster ID: 3b408192a0364dcd887330275135a4c2
I20260924 12:58:47.544135 823 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:47.577942 823 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:47.580049 823 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:47.600584 823 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05248596b5fa4e5d9450511dd013e1ff: Generated new TSK 0
I20260924 12:58:47.602102 823 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:47.617975 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 736
I20260924 12:58:47.619607 798 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:47.736030 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 736
W20260924 12:58:47.754535 721 connection.cc:535] client connection to 127.11.49.126:35441 recv error: Network error: failed to read from TLS socket (remote: 127.11.49.126:35441): Connection reset by peer (error 104)
2026-09-24T12:58:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2288 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:47 dist-test-slave-m9hg krb5kdc[835](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:47 dist-test-slave-m9hg krb5kdc[835](info): set up 2 sockets
Sep 24 12:58:47 dist-test-slave-m9hg krb5kdc[835](info): commencing operation
krb5kdc: starting...
W20260924 12:58:48.898063 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:49 dist-test-slave-m9hg krb5kdc[835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:58:49.228598 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:35323
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:41921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:35323
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:49.674527 848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:49.675016 848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:49.675221 848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:49.685114 848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:49.685385 848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:49.685524 848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:49.685657 848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:49.685747 848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:49.698865 848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:41921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:35323
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:35323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:49.701272 848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:49.703890 848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:49.722108 853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:49.722219 856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:49.722160 854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:49.723359 848 server_base.cc:1034] running on GCE node
I20260924 12:58:49.724543 848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:49.726991 848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:49.728384 848 hybrid_clock.cc:648] HybridClock initialized: now 1790254729728292 us; error 65 us; skew 500 ppm
I20260924 12:58:49.728890 848 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:49 dist-test-slave-m9hg krb5kdc[835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254729, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:49.740051 848 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:58:49.742904 848 webserver.cc:460] Webserver started at http://127.11.49.126:44633/ using document root <none> and password file <none>
I20260924 12:58:49.743960 848 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:49.744169 848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:49.744656 848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:49.748807 848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "6e7b35c276654bcf984b05cd535afedc"
format_stamp: "Formatted at 2026-09-24 12:58:49 on dist-test-slave-m9hg"
server_key: "6433208886d52549621c8ff479b96755"
server_key_iv: "46cecd4543a504a26884eb86c1d46d03"
server_key_version: "encryptionkey@0"
I20260924 12:58:49.749881 848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "6e7b35c276654bcf984b05cd535afedc"
format_stamp: "Formatted at 2026-09-24 12:58:49 on dist-test-slave-m9hg"
server_key: "6433208886d52549621c8ff479b96755"
server_key_iv: "46cecd4543a504a26884eb86c1d46d03"
server_key_version: "encryptionkey@0"
I20260924 12:58:49.757171 848 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.004s
I20260924 12:58:49.764084 863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:49.766638 848 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260924 12:58:49.766973 848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "6e7b35c276654bcf984b05cd535afedc"
format_stamp: "Formatted at 2026-09-24 12:58:49 on dist-test-slave-m9hg"
server_key: "6433208886d52549621c8ff479b96755"
server_key_iv: "46cecd4543a504a26884eb86c1d46d03"
server_key_version: "encryptionkey@0"
I20260924 12:58:49.767356 848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:49.789862 848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:49.795749 848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:49.796118 848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:49.820395 848 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:35323
I20260924 12:58:49.820395 914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:35323 every 8 connection(s)
I20260924 12:58:49.822640 848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:49.824651 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 848
I20260924 12:58:49.824880 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:49.825402 11461 external_mini_cluster.cc:1428] Setting key 4e190aa2acff0f634836a5de53934d7f
I20260924 12:58:49.828114 915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:49.843755 918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:49.828199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49157 (local address 127.11.49.126:35323)
0924 12:58:49.829381 (+ 1182us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:49.829398 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:49.829462 (+ 64us) server_negotiation.cc:407] Connection header received
0924 12:58:49.831703 (+ 2241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:49.831735 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:49.832366 (+ 631us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:49.832892 (+ 526us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:49.833686 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:49.835894 (+ 2208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:49.837632 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:49.838711 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:49.838963 (+ 252us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:49.840639 (+ 1676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:49.840649 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:49.840669 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:49.841507 (+ 838us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:49.841608 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:49.841647 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:49.841852 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:49.842196 (+ 344us) server_negotiation.cc:299] Negotiation successful
0924 12:58:49.842386 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":840,"thread_start_us":492,"threads_started":1}
I20260924 12:58:49.844079 915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc: Bootstrap starting.
I20260924 12:58:49.847654 915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:49.849004 915 log.cc:824] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:49.849782 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:49.853061 915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc: No bootstrap required, opened a new log
I20260924 12:58:49.864929 915 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7b35c276654bcf984b05cd535afedc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35323 } }
I20260924 12:58:49.865475 915 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:49.865625 918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:49.856789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53441 (local address 127.11.49.126:35323)
0924 12:58:49.857032 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:49.857039 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:49.857404 (+ 365us) server_negotiation.cc:407] Connection header received
0924 12:58:49.857677 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:49.857683 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:49.857784 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:49.857915 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:49.858617 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:49.859856 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:49.861931 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:49.862593 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:49.862775 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:49.864410 (+ 1635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:49.864418 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:49.864423 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:49.864452 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:49.864555 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:49.864581 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:49.864717 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:49.865037 (+ 320us) server_negotiation.cc:299] Negotiation successful
0924 12:58:49.865177 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260924 12:58:49.865628 915 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e7b35c276654bcf984b05cd535afedc, State: Initialized, Role: FOLLOWER
I20260924 12:58:49.866530 915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7b35c276654bcf984b05cd535afedc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35323 } }
I20260924 12:58:49.866860 915 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:49.867017 915 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:49.867223 915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:49.869643 915 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7b35c276654bcf984b05cd535afedc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35323 } }
I20260924 12:58:49.870245 915 leader_election.cc:302] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e7b35c276654bcf984b05cd535afedc; no voters:
I20260924 12:58:49.870955 915 leader_election.cc:288] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:49.871542 925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:49.872810 925 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [term 1 LEADER]: Becoming Leader. State: Replica: 6e7b35c276654bcf984b05cd535afedc, State: Running, Role: LEADER
I20260924 12:58:49.873732 915 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:49.874097 925 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7b35c276654bcf984b05cd535afedc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35323 } }
I20260924 12:58:49.878780 926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e7b35c276654bcf984b05cd535afedc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7b35c276654bcf984b05cd535afedc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35323 } } }
I20260924 12:58:49.879411 926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:49.880854 927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e7b35c276654bcf984b05cd535afedc. Latest consensus state: current_term: 1 leader_uuid: "6e7b35c276654bcf984b05cd535afedc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7b35c276654bcf984b05cd535afedc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 35323 } } }
I20260924 12:58:49.881379 927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:49.887859 932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:49.896587 932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:49.909463 932 catalog_manager.cc:1347] Generated new cluster ID: 1a4cd45e8bce4495b374706f3034e6e9
I20260924 12:58:49.909629 932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:49.938794 932 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:49.940433 932 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:49.962174 932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e7b35c276654bcf984b05cd535afedc: Generated new TSK 0
I20260924 12:58:49.963907 932 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:49.984082 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 848
W20260924 12:58:49.985843 910 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49157
W20260924 12:58:49.986769 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 848: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:49.986927 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 848
W20260924 12:58:50.005616 833 connection.cc:535] client connection to 127.11.49.126:35323 recv error: Network error: failed to read from TLS socket (remote: 127.11.49.126:35323): Connection reset by peer (error 104)
2026-09-24T12:58:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2251 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:50 dist-test-slave-m9hg krb5kdc[947](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:50 dist-test-slave-m9hg krb5kdc[947](info): set up 2 sockets
Sep 24 12:58:50 dist-test-slave-m9hg krb5kdc[947](info): commencing operation
krb5kdc: starting...
W20260924 12:58:51.145560 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:51 dist-test-slave-m9hg krb5kdc[947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:58:51.473126 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:32811
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:35927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:32811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:51.919288 960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:51.919706 960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:51.919870 960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:51.928404 960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:51.928578 960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:51.928676 960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:51.928790 960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:51.928891 960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:51.940589 960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:35927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:32811
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:32811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:51.942530 960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:51.944377 960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:51.960068 965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:51.960414 966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:51.960389 968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:51.962234 960 server_base.cc:1034] running on GCE node
I20260924 12:58:51.963325 960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:51.965390 960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:51.966679 960 hybrid_clock.cc:648] HybridClock initialized: now 1790254731966600 us; error 54 us; skew 500 ppm
I20260924 12:58:51.967280 960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:51 dist-test-slave-m9hg krb5kdc[947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254731, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:51.971845 960 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:58:51.974309 960 webserver.cc:460] Webserver started at http://127.11.49.126:41765/ using document root <none> and password file <none>
I20260924 12:58:51.975409 960 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:51.975616 960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:51.976082 960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:51.980895 960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "ba8057805a674f4bb44ff69f6e3cd219"
format_stamp: "Formatted at 2026-09-24 12:58:51 on dist-test-slave-m9hg"
server_key: "945f0442b06430b317d52777f3ced3c2"
server_key_iv: "28daa55c372f6a0598cd39049b14990a"
server_key_version: "encryptionkey@0"
I20260924 12:58:51.982091 960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "ba8057805a674f4bb44ff69f6e3cd219"
format_stamp: "Formatted at 2026-09-24 12:58:51 on dist-test-slave-m9hg"
server_key: "945f0442b06430b317d52777f3ced3c2"
server_key_iv: "28daa55c372f6a0598cd39049b14990a"
server_key_version: "encryptionkey@0"
I20260924 12:58:51.989822 960 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260924 12:58:51.995472 975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:51.997471 960 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260924 12:58:51.997738 960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "ba8057805a674f4bb44ff69f6e3cd219"
format_stamp: "Formatted at 2026-09-24 12:58:51 on dist-test-slave-m9hg"
server_key: "945f0442b06430b317d52777f3ced3c2"
server_key_iv: "28daa55c372f6a0598cd39049b14990a"
server_key_version: "encryptionkey@0"
I20260924 12:58:51.998024 960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:52.005729 960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:52.011618 960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:52.012089 960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:52.038357 960 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:32811
I20260924 12:58:52.038383 1026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:32811 every 8 connection(s)
I20260924 12:58:52.040508 960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:52.044962 1027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:52.048590 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 960
I20260924 12:58:52.048835 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:52.049350 11461 external_mini_cluster.cc:1428] Setting key be752e689a4e1a993dff0d5dd9e4f9e8
I20260924 12:58:52.057030 1027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219: Bootstrap starting.
I20260924 12:58:52.060079 1030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:52.051668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42533 (local address 127.11.49.126:32811)
0924 12:58:52.052759 (+ 1091us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:52.052774 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:52.052829 (+ 55us) server_negotiation.cc:407] Connection header received
0924 12:58:52.055759 (+ 2930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:52.055795 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:52.056438 (+ 643us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:52.056920 (+ 482us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:52.058152 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:52.058159 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:52.058173 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:52.058186 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:52.058250 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:52.058272 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:52.058477 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:52.058595 (+ 118us) server_negotiation.cc:299] Negotiation successful
0924 12:58:52.058861 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":834,"thread_start_us":531,"threads_started":1}
I20260924 12:58:52.060866 1027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:52.062036 1027 log.cc:824] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:52.065254 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:52.066172 1027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219: No bootstrap required, opened a new log
I20260924 12:58:52.073573 1030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:52.070359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60759 (local address 127.11.49.126:32811)
0924 12:58:52.070624 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:52.070632 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:52.070805 (+ 173us) server_negotiation.cc:407] Connection header received
0924 12:58:52.070974 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:52.070980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:52.071074 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:52.071247 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:52.072408 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:52.072416 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:52.072426 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:52.072452 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:52.072528 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:52.072559 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:52.072734 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:52.072975 (+ 241us) server_negotiation.cc:299] Negotiation successful
0924 12:58:52.073193 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260924 12:58:52.077654 1027 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8057805a674f4bb44ff69f6e3cd219" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 32811 } }
I20260924 12:58:52.078209 1027 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:52.078299 1027 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba8057805a674f4bb44ff69f6e3cd219, State: Initialized, Role: FOLLOWER
I20260924 12:58:52.078941 1027 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8057805a674f4bb44ff69f6e3cd219" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 32811 } }
I20260924 12:58:52.079211 1027 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:52.079324 1027 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:52.079473 1027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:52.082283 1027 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8057805a674f4bb44ff69f6e3cd219" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 32811 } }
I20260924 12:58:52.083449 1027 leader_election.cc:302] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba8057805a674f4bb44ff69f6e3cd219; no voters:
I20260924 12:58:52.084444 1027 leader_election.cc:288] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:52.084635 1037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:52.085577 1037 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [term 1 LEADER]: Becoming Leader. State: Replica: ba8057805a674f4bb44ff69f6e3cd219, State: Running, Role: LEADER
I20260924 12:58:52.086421 1037 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8057805a674f4bb44ff69f6e3cd219" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 32811 } }
I20260924 12:58:52.087957 1027 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:52.089659 1038 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba8057805a674f4bb44ff69f6e3cd219" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8057805a674f4bb44ff69f6e3cd219" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 32811 } } }
I20260924 12:58:52.089756 1039 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba8057805a674f4bb44ff69f6e3cd219. Latest consensus state: current_term: 1 leader_uuid: "ba8057805a674f4bb44ff69f6e3cd219" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8057805a674f4bb44ff69f6e3cd219" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 32811 } } }
I20260924 12:58:52.090690 1039 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:52.090691 1038 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:52.093374 1043 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:52.100498 1043 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:52.112664 1043 catalog_manager.cc:1347] Generated new cluster ID: c3ce63234a3447cc9af15f9fd2fed94d
I20260924 12:58:52.112812 1043 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:52.151265 1043 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:52.151917 1043 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:52.163756 1043 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba8057805a674f4bb44ff69f6e3cd219: Generated new TSK 0
I20260924 12:58:52.165027 1043 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:52.179998 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 960
W20260924 12:58:52.181581 1022 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42533
W20260924 12:58:52.182608 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 960: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:52.182814 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 960
2026-09-24T12:58:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2197 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:52 dist-test-slave-m9hg krb5kdc[1058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:52 dist-test-slave-m9hg krb5kdc[1058](info): set up 2 sockets
Sep 24 12:58:52 dist-test-slave-m9hg krb5kdc[1058](info): commencing operation
krb5kdc: starting...
W20260924 12:58:53.353618 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:53 dist-test-slave-m9hg krb5kdc[1058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:58:53.693262 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42795
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:35419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:42795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:54.063102 1071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:54.063493 1071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:54.063669 1071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:54.071180 1071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:54.071377 1071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:54.071480 1071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:54.071594 1071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:54.071684 1071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:54.081979 1071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:35419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:42795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:42795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:54.083406 1071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:54.084851 1071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:54.098630 1076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:54.098687 1077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:54.099284 1079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:54.100402 1071 server_base.cc:1034] running on GCE node
I20260924 12:58:54.101254 1071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:54.102958 1071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:54.104221 1071 hybrid_clock.cc:648] HybridClock initialized: now 1790254734104140 us; error 75 us; skew 500 ppm
I20260924 12:58:54.104684 1071 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:54 dist-test-slave-m9hg krb5kdc[1058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254734, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:54.108026 1071 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:58:54.109985 1071 webserver.cc:460] Webserver started at http://127.11.49.126:46059/ using document root <none> and password file <none>
I20260924 12:58:54.110745 1071 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:54.110873 1071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:54.111236 1071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:54.114395 1071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "d8d1d233946e4493845921824b3cc266"
format_stamp: "Formatted at 2026-09-24 12:58:54 on dist-test-slave-m9hg"
server_key: "5c0396e7a8d33108acbe404463989ebc"
server_key_iv: "d53f7feba3878f4145b3bb5b1c53a54e"
server_key_version: "encryptionkey@0"
I20260924 12:58:54.115242 1071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "d8d1d233946e4493845921824b3cc266"
format_stamp: "Formatted at 2026-09-24 12:58:54 on dist-test-slave-m9hg"
server_key: "5c0396e7a8d33108acbe404463989ebc"
server_key_iv: "d53f7feba3878f4145b3bb5b1c53a54e"
server_key_version: "encryptionkey@0"
I20260924 12:58:54.121522 1071 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260924 12:58:54.126480 1086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:54.128501 1071 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.002s
I20260924 12:58:54.128753 1071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "d8d1d233946e4493845921824b3cc266"
format_stamp: "Formatted at 2026-09-24 12:58:54 on dist-test-slave-m9hg"
server_key: "5c0396e7a8d33108acbe404463989ebc"
server_key_iv: "d53f7feba3878f4145b3bb5b1c53a54e"
server_key_version: "encryptionkey@0"
I20260924 12:58:54.129040 1071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:54.170572 1071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:54.175616 1071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:54.176013 1071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:54.198210 1071 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:42795
I20260924 12:58:54.198390 1137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:42795 every 8 connection(s)
I20260924 12:58:54.199672 1071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:54.203547 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 1071
I20260924 12:58:54.203789 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:54.204459 11461 external_mini_cluster.cc:1428] Setting key 7629bccd82f91b2286946a6e49b2b496
I20260924 12:58:54.205302 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 24 12:58:54 dist-test-slave-m9hg krb5kdc[1058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:58:54.221688 1138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266: Bootstrap starting.
I20260924 12:58:54.226751 1138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:54.228561 1138 log.cc:824] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:54.230211 1141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:54.206971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42079 (local address 127.11.49.126:42795)
0924 12:58:54.207952 (+ 981us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:54.207971 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:54.208018 (+ 47us) server_negotiation.cc:407] Connection header received
0924 12:58:54.209824 (+ 1806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:54.209852 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:54.210373 (+ 521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:54.210838 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:54.212456 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:54.213932 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:54.215257 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:54.216033 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:54.216243 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:54.221217 (+ 4974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:54.221226 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:54.221244 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:54.221290 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:54.224870 (+ 3580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:54.226054 (+ 1184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:54.226061 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:54.226068 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:54.226260 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:54.226758 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:54.226761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:54.226763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:54.227458 (+ 695us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:54.227691 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:54.228322 (+ 631us) server_negotiation.cc:299] Negotiation successful
0924 12:58:54.228780 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":433,"threads_started":1}
I20260924 12:58:54.233191 1138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266: No bootstrap required, opened a new log
I20260924 12:58:54.235077 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:54.245565 1138 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d1d233946e4493845921824b3cc266" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42795 } }
I20260924 12:58:54.246280 1138 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:54.246395 1138 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8d1d233946e4493845921824b3cc266, State: Initialized, Role: FOLLOWER
I20260924 12:58:54.247265 1138 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d1d233946e4493845921824b3cc266" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42795 } }
I20260924 12:58:54.247627 1138 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:54.247803 1138 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:54.248042 1138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:54.251192 1138 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d1d233946e4493845921824b3cc266" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42795 } }
I20260924 12:58:54.252132 1138 leader_election.cc:302] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8d1d233946e4493845921824b3cc266; no voters:
I20260924 12:58:54.253120 1138 leader_election.cc:288] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:54.253382 1148 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:54.255193 1148 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [term 1 LEADER]: Becoming Leader. State: Replica: d8d1d233946e4493845921824b3cc266, State: Running, Role: LEADER
I20260924 12:58:54.256007 1148 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d1d233946e4493845921824b3cc266" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42795 } }
I20260924 12:58:54.256604 1138 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:54.259217 1150 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8d1d233946e4493845921824b3cc266. Latest consensus state: current_term: 1 leader_uuid: "d8d1d233946e4493845921824b3cc266" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d1d233946e4493845921824b3cc266" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42795 } } }
I20260924 12:58:54.259652 1150 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:54.260507 1149 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8d1d233946e4493845921824b3cc266" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d1d233946e4493845921824b3cc266" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 42795 } } }
I20260924 12:58:54.260946 1149 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:54.262317 1141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:54.242140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54993 (local address 127.11.49.126:42795)
0924 12:58:54.242407 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:54.242414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:54.242727 (+ 313us) server_negotiation.cc:407] Connection header received
0924 12:58:54.242899 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:54.242906 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:54.243025 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:54.243204 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:54.244874 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:54.246041 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:54.247485 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:54.248324 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:54.248544 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:54.251146 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:54.251157 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:54.251169 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:58:54.251228 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:54.255808 (+ 4580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:54.256892 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:54.256899 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:54.256903 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:54.257124 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:58:54.257794 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:58:54.257799 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:58:54.257802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:58:54.258419 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:54.260812 (+ 2393us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:54.261261 (+ 449us) server_negotiation.cc:299] Negotiation successful
0924 12:58:54.261684 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260924 12:58:54.267421 1155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:54.273164 1155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:54.286039 1155 catalog_manager.cc:1347] Generated new cluster ID: d82b08cc9e4b4452b93253714978c37c
I20260924 12:58:54.286167 1155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:54.315296 1155 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:54.317919 1155 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:54.328230 1155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8d1d233946e4493845921824b3cc266: Generated new TSK 0
I20260924 12:58:54.329777 1155 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:54.343137 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 1071
I20260924 12:58:54.344451 1133 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:58:54.453258 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 1071
2026-09-24T12:58:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2267 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:54 dist-test-slave-m9hg krb5kdc[1170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:54 dist-test-slave-m9hg krb5kdc[1170](info): set up 2 sockets
Sep 24 12:58:54 dist-test-slave-m9hg krb5kdc[1170](info): commencing operation
krb5kdc: starting...
W20260924 12:58:55.617950 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.007s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:55 dist-test-slave-m9hg krb5kdc[1170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:58:55.940671 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:36331
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:44841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:36331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:56.283905 1183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:56.284243 1183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:56.284519 1183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:56.292342 1183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:56.292478 1183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:56.292526 1183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:56.292647 1183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:56.292712 1183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:56.302987 1183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:44841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:36331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:36331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:56.304467 1183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:56.305830 1183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:56.319944 1188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:56.319960 1189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:56.320209 1191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:56.320999 1183 server_base.cc:1034] running on GCE node
I20260924 12:58:56.322148 1183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:56.324354 1183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:56.325685 1183 hybrid_clock.cc:648] HybridClock initialized: now 1790254736325594 us; error 87 us; skew 500 ppm
I20260924 12:58:56.326221 1183 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:56 dist-test-slave-m9hg krb5kdc[1170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254736, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:56.336767 1183 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:58:56.339090 1183 webserver.cc:460] Webserver started at http://127.11.49.126:34383/ using document root <none> and password file <none>
I20260924 12:58:56.340426 1183 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:56.340770 1183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:56.341301 1183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:56.345538 1183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "fdaa39df16fb474fb5683e457976af14"
format_stamp: "Formatted at 2026-09-24 12:58:56 on dist-test-slave-m9hg"
server_key: "bc90a58ebbe18b78da1da39cd75514a9"
server_key_iv: "eca1ff2bfe62c0fd549ef79bda195537"
server_key_version: "encryptionkey@0"
I20260924 12:58:56.346678 1183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "fdaa39df16fb474fb5683e457976af14"
format_stamp: "Formatted at 2026-09-24 12:58:56 on dist-test-slave-m9hg"
server_key: "bc90a58ebbe18b78da1da39cd75514a9"
server_key_iv: "eca1ff2bfe62c0fd549ef79bda195537"
server_key_version: "encryptionkey@0"
I20260924 12:58:56.354802 1183 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260924 12:58:56.360031 1198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:56.362385 1183 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260924 12:58:56.362712 1183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "fdaa39df16fb474fb5683e457976af14"
format_stamp: "Formatted at 2026-09-24 12:58:56 on dist-test-slave-m9hg"
server_key: "bc90a58ebbe18b78da1da39cd75514a9"
server_key_iv: "eca1ff2bfe62c0fd549ef79bda195537"
server_key_version: "encryptionkey@0"
I20260924 12:58:56.363039 1183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:56.402303 1183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:56.408560 1183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:56.408972 1183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:56.433135 1183 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:36331
I20260924 12:58:56.433140 1249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:36331 every 8 connection(s)
I20260924 12:58:56.435144 1183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:56.435796 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 1183
I20260924 12:58:56.436003 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:56.436659 11461 external_mini_cluster.cc:1428] Setting key 96ba8fa491cba152f03789b6fd7f3e83
I20260924 12:58:56.440608 1250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:56.454499 1250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14: Bootstrap starting.
I20260924 12:58:56.454521 1253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:56.439089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55693 (local address 127.11.49.126:36331)
0924 12:58:56.440125 (+ 1036us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:56.440141 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:56.440202 (+ 61us) server_negotiation.cc:407] Connection header received
0924 12:58:56.442307 (+ 2105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:56.442337 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:56.442882 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:56.443362 (+ 480us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:56.444176 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:56.445930 (+ 1754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:56.448068 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:56.449222 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:56.449455 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:56.451082 (+ 1627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:56.451092 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:56.451145 (+ 53us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:56.451960 (+ 815us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:56.452088 (+ 128us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:56.452132 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:56.452255 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:56.452673 (+ 418us) server_negotiation.cc:299] Negotiation successful
0924 12:58:56.453116 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":771,"thread_start_us":465,"threads_started":1}
I20260924 12:58:56.458469 1250 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:56.459775 1250 log.cc:824] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:56.460510 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:56.463370 1250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14: No bootstrap required, opened a new log
I20260924 12:58:56.473376 1250 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdaa39df16fb474fb5683e457976af14" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36331 } }
I20260924 12:58:56.473848 1250 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:56.474004 1250 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdaa39df16fb474fb5683e457976af14, State: Initialized, Role: FOLLOWER
I20260924 12:58:56.475001 1253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:56.466228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36811 (local address 127.11.49.126:36331)
0924 12:58:56.466483 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:56.466491 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:56.467339 (+ 848us) server_negotiation.cc:407] Connection header received
0924 12:58:56.467576 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:56.467583 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:56.467672 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:56.467833 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:56.468693 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:56.469935 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:56.471609 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:58:56.472386 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:58:56.472553 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:58:56.474025 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:56.474033 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:56.474038 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:56.474065 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:56.474127 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:56.474150 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:56.474280 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:56.474475 (+ 195us) server_negotiation.cc:299] Negotiation successful
0924 12:58:56.474593 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260924 12:58:56.474805 1250 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdaa39df16fb474fb5683e457976af14" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36331 } }
I20260924 12:58:56.475164 1250 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:56.475329 1250 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:56.475493 1250 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:56.478266 1250 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdaa39df16fb474fb5683e457976af14" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36331 } }
I20260924 12:58:56.478855 1250 leader_election.cc:302] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdaa39df16fb474fb5683e457976af14; no voters:
I20260924 12:58:56.479619 1250 leader_election.cc:288] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:56.479897 1260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:56.481396 1260 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [term 1 LEADER]: Becoming Leader. State: Replica: fdaa39df16fb474fb5683e457976af14, State: Running, Role: LEADER
I20260924 12:58:56.482183 1250 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:56.482183 1260 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdaa39df16fb474fb5683e457976af14" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36331 } }
I20260924 12:58:56.486766 1262 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdaa39df16fb474fb5683e457976af14. Latest consensus state: current_term: 1 leader_uuid: "fdaa39df16fb474fb5683e457976af14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdaa39df16fb474fb5683e457976af14" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36331 } } }
I20260924 12:58:56.486685 1261 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdaa39df16fb474fb5683e457976af14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdaa39df16fb474fb5683e457976af14" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 36331 } } }
I20260924 12:58:56.487352 1262 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:56.487393 1261 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14 [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:56.497074 1270 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:56.503927 1270 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:56.515269 1270 catalog_manager.cc:1347] Generated new cluster ID: 08bb4a088b554485bd14089fc48403b0
I20260924 12:58:56.515446 1270 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:56.545835 1270 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:56.547989 1270 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:56.563170 1270 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdaa39df16fb474fb5683e457976af14: Generated new TSK 0
I20260924 12:58:56.564502 1270 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:56.586985 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 1183
W20260924 12:58:56.588733 1245 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55693
W20260924 12:58:56.589745 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 1183: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:56.590011 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 1183
2026-09-24T12:58:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2139 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:56 dist-test-slave-m9hg krb5kdc[1281](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:56 dist-test-slave-m9hg krb5kdc[1281](info): set up 2 sockets
Sep 24 12:58:56 dist-test-slave-m9hg krb5kdc[1281](info): commencing operation
krb5kdc: starting...
W20260924 12:58:57.773595 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:58:57 dist-test-slave-m9hg krb5kdc[1281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:58:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:58:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:58:58.121585 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:45511
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:46771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:45511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:58:58.556702 1294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:58:58.557117 1294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:58:58.557227 1294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:58:58.566087 1294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:58:58.566295 1294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:58:58.566362 1294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:58:58.566447 1294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:58:58.566514 1294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:58:58.580552 1294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:46771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:45511
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:45511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:58:58.582552 1294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:58:58.584489 1294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:58:58.601774 1299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:58.601855 1302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:58:58.601727 1300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:58:58.606750 1294 server_base.cc:1034] running on GCE node
I20260924 12:58:58.607998 1294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:58:58.610448 1294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:58:58.611848 1294 hybrid_clock.cc:648] HybridClock initialized: now 1790254738611735 us; error 102 us; skew 500 ppm
I20260924 12:58:58.612563 1294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:58:58 dist-test-slave-m9hg krb5kdc[1281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254738, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:58:58.617352 1294 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:58:58.619621 1294 webserver.cc:460] Webserver started at http://127.11.49.126:45189/ using document root <none> and password file <none>
I20260924 12:58:58.620711 1294 fs_manager.cc:359] Metadata directory not provided
I20260924 12:58:58.620886 1294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:58:58.621284 1294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:58:58.625403 1294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "580b7c4cd8d447048fadd1cb72783afc"
format_stamp: "Formatted at 2026-09-24 12:58:58 on dist-test-slave-m9hg"
server_key: "81784eb70c4b3f4352e1290b8b9f49bf"
server_key_iv: "902352aee89224ff4f0d663445fae9db"
server_key_version: "encryptionkey@0"
I20260924 12:58:58.626467 1294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "580b7c4cd8d447048fadd1cb72783afc"
format_stamp: "Formatted at 2026-09-24 12:58:58 on dist-test-slave-m9hg"
server_key: "81784eb70c4b3f4352e1290b8b9f49bf"
server_key_iv: "902352aee89224ff4f0d663445fae9db"
server_key_version: "encryptionkey@0"
I20260924 12:58:58.634032 1294 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260924 12:58:58.639171 1309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:58:58.641511 1294 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260924 12:58:58.641836 1294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "580b7c4cd8d447048fadd1cb72783afc"
format_stamp: "Formatted at 2026-09-24 12:58:58 on dist-test-slave-m9hg"
server_key: "81784eb70c4b3f4352e1290b8b9f49bf"
server_key_iv: "902352aee89224ff4f0d663445fae9db"
server_key_version: "encryptionkey@0"
I20260924 12:58:58.642139 1294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:58:58.650321 1294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:58:58.657393 1294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:58:58.657828 1294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:58:58.684356 1294 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:45511
I20260924 12:58:58.684478 1360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:45511 every 8 connection(s)
I20260924 12:58:58.686312 1294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:58:58.687083 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 1294
I20260924 12:58:58.687330 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:58:58.688000 11461 external_mini_cluster.cc:1428] Setting key ab52649d2661156978cb0321a1b56395
I20260924 12:58:58.692328 1361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:58:58.697679 1364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:58.690298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48115 (local address 127.11.49.126:45511)
0924 12:58:58.691388 (+ 1090us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:58.691404 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:58.691460 (+ 56us) server_negotiation.cc:407] Connection header received
0924 12:58:58.693516 (+ 2056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:58.693544 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:58.693991 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:58.694443 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:58.695736 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:58.695742 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:58.695756 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:58.695777 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:58.695883 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:58.695906 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:58.696181 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:58.696364 (+ 183us) server_negotiation.cc:299] Negotiation successful
0924 12:58:58.696583 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":789,"thread_start_us":494,"threads_started":1}
I20260924 12:58:58.702659 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:58:58.710359 1361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc: Bootstrap starting.
I20260924 12:58:58.713963 1364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:58:58.710462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52673 (local address 127.11.49.126:45511)
0924 12:58:58.710731 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0924 12:58:58.710741 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:58:58.711414 (+ 673us) server_negotiation.cc:407] Connection header received
0924 12:58:58.711570 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:58:58.711576 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:58:58.711676 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:58:58.711841 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:58:58.713079 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:58:58.713086 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:58:58.713090 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 12:58:58.713113 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:58:58.713174 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 12:58:58.713197 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:58:58.713368 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0924 12:58:58.713536 (+ 168us) server_negotiation.cc:299] Negotiation successful
0924 12:58:58.713615 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260924 12:58:58.715307 1361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc: Neither blocks nor log segments found. Creating new log.
I20260924 12:58:58.716800 1361 log.cc:824] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc: Log is configured to *not* fsync() on all Append() calls
I20260924 12:58:58.720988 1361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc: No bootstrap required, opened a new log
I20260924 12:58:58.730628 1361 raft_consensus.cc:348] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580b7c4cd8d447048fadd1cb72783afc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45511 } }
I20260924 12:58:58.731223 1361 raft_consensus.cc:374] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 12:58:58.731357 1361 raft_consensus.cc:729] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 580b7c4cd8d447048fadd1cb72783afc, State: Initialized, Role: FOLLOWER
I20260924 12:58:58.732311 1361 consensus_queue.cc:260] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580b7c4cd8d447048fadd1cb72783afc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45511 } }
I20260924 12:58:58.732672 1361 raft_consensus.cc:388] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 12:58:58.732860 1361 raft_consensus.cc:482] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 12:58:58.733071 1361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:58:58.735728 1361 raft_consensus.cc:504] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580b7c4cd8d447048fadd1cb72783afc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45511 } }
I20260924 12:58:58.736487 1361 leader_election.cc:302] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 580b7c4cd8d447048fadd1cb72783afc; no voters:
I20260924 12:58:58.737278 1361 leader_election.cc:288] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 12:58:58.737563 1371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:58:58.738610 1371 raft_consensus.cc:686] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [term 1 LEADER]: Becoming Leader. State: Replica: 580b7c4cd8d447048fadd1cb72783afc, State: Running, Role: LEADER
I20260924 12:58:58.739470 1371 consensus_queue.cc:237] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580b7c4cd8d447048fadd1cb72783afc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45511 } }
I20260924 12:58:58.740056 1361 sys_catalog.cc:564] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:58:58.743209 1372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "580b7c4cd8d447048fadd1cb72783afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580b7c4cd8d447048fadd1cb72783afc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45511 } } }
I20260924 12:58:58.743825 1372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:58.743335 1373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 580b7c4cd8d447048fadd1cb72783afc. Latest consensus state: current_term: 1 leader_uuid: "580b7c4cd8d447048fadd1cb72783afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580b7c4cd8d447048fadd1cb72783afc" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45511 } } }
I20260924 12:58:58.744783 1373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc [sys.catalog]: This master's current role is: LEADER
I20260924 12:58:58.744868 1378 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:58:58.760020 1378 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:58:58.772100 1378 catalog_manager.cc:1347] Generated new cluster ID: d8b08a0ac1274643b0fd2698c16f5eb6
I20260924 12:58:58.772359 1378 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:58:58.796895 1378 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:58:58.797628 1378 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:58:58.810966 1378 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 580b7c4cd8d447048fadd1cb72783afc: Generated new TSK 0
I20260924 12:58:58.812379 1378 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:58:58.823490 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 1294
W20260924 12:58:58.825081 1356 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48115
W20260924 12:58:58.826135 11461 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 1294: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260924 12:58:58.826339 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 1294
2026-09-24T12:58:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2233 ms)
[----------] 18 tests from AuthTokenIssuingTest (40404 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:58:58 dist-test-slave-m9hg krb5kdc[1392](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:58:58 dist-test-slave-m9hg krb5kdc[1392](info): set up 2 sockets
Sep 24 12:58:58 dist-test-slave-m9hg krb5kdc[1392](info): commencing operation
krb5kdc: starting...
W20260924 12:58:59.973949 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.005s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:59:00 dist-test-slave-m9hg krb5kdc[1392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:59:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:59:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:59:00.305696 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:33777
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:35107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:33777,127.11.49.125:41197,127.11.49.124:41751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:59:00.758240 1405 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 12:59:00.758762 1405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:59:00.758931 1405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:59:00.759086 1405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:59:00.769448 1405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:59:00.769613 1405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:59:00.769742 1405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:59:00.769856 1405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:59:00.769975 1405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:59:00.782944 1405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:35107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:33777,127.11.49.125:41197,127.11.49.124:41751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:33777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:59:00.784842 1405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:59:00.786624 1405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:59:00.802386 1410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:00.803040 1411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:00.803314 1413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:59:00.803793 1405 server_base.cc:1034] running on GCE node
I20260924 12:59:00.805080 1405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:59:00.807276 1405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:59:00.808599 1405 hybrid_clock.cc:648] HybridClock initialized: now 1790254740808512 us; error 52 us; skew 500 ppm
I20260924 12:59:00.809087 1405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:59:00 dist-test-slave-m9hg krb5kdc[1392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254740, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:59:00.813796 1405 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:59:00.816210 1405 webserver.cc:460] Webserver started at http://127.11.49.126:40069/ using document root <none> and password file <none>
I20260924 12:59:00.817361 1405 fs_manager.cc:359] Metadata directory not provided
I20260924 12:59:00.817543 1405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:59:00.817987 1405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:59:00.822316 1405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "49b994b3bf494993bfef75289df36f8b"
format_stamp: "Formatted at 2026-09-24 12:59:00 on dist-test-slave-m9hg"
server_key: "da35a8bc378fbab4e2f8714d9c04b0ba"
server_key_iv: "9690a424380524d3d34fd56e4f4f9abc"
server_key_version: "encryptionkey@0"
I20260924 12:59:00.823518 1405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "49b994b3bf494993bfef75289df36f8b"
format_stamp: "Formatted at 2026-09-24 12:59:00 on dist-test-slave-m9hg"
server_key: "da35a8bc378fbab4e2f8714d9c04b0ba"
server_key_iv: "9690a424380524d3d34fd56e4f4f9abc"
server_key_version: "encryptionkey@0"
I20260924 12:59:00.831607 1405 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260924 12:59:00.837579 1420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:59:00.839896 1405 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.002s
I20260924 12:59:00.840245 1405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "49b994b3bf494993bfef75289df36f8b"
format_stamp: "Formatted at 2026-09-24 12:59:00 on dist-test-slave-m9hg"
server_key: "da35a8bc378fbab4e2f8714d9c04b0ba"
server_key_iv: "9690a424380524d3d34fd56e4f4f9abc"
server_key_version: "encryptionkey@0"
I20260924 12:59:00.840636 1405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:59:00.860594 1405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:59:00.867201 1405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:59:00.867606 1405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:59:00.891883 1405 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:33777
I20260924 12:59:00.891920 1471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:33777 every 8 connection(s)
I20260924 12:59:00.893712 1405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:59:00.898051 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:59:00.901705 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 1405
I20260924 12:59:00.901948 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:59:00.902796 11461 external_mini_cluster.cc:1428] Setting key f01f82961da5909ec8d25b67b62e9a90
I20260924 12:59:00.907295 1472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:59:00 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254740, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.49.125@KRBTEST.COM; defaulting to no policy
I20260924 12:59:00.938771 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:00.911881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:33777 (local address 127.0.0.1:47968)
0924 12:59:00.912995 (+ 1114us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:00.913054 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:00.916554 (+ 3500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:00.917920 (+ 1366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:00.917931 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:00.919001 (+ 1070us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:00.919661 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:00.919695 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:00.921554 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:00.921563 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:00.923836 (+ 2273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:00.923866 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:00.925399 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:00.925409 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:00.925694 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:00.926662 (+ 968us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:00.926702 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:00.930151 (+ 3449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:00.934235 (+ 4084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:00.934248 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:00.934262 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:00.934697 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:00.935121 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:00.935125 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:00.935140 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:00.935287 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:00.936137 (+ 850us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:00.936146 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:00.936412 (+ 266us) client_negotiation.cc:769] Sending connection context
0924 12:59:00.936698 (+ 286us) client_negotiation.cc:240] Negotiation successful
0924 12:59:00.937340 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":156,"thread_start_us":490,"threads_started":1}
I20260924 12:59:00.938800 1475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:00.913655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47968 (local address 127.11.49.126:33777)
0924 12:59:00.914573 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:00.914581 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:00.914640 (+ 59us) server_negotiation.cc:407] Connection header received
0924 12:59:00.917150 (+ 2510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:00.917159 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:00.917547 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:00.917760 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:00.919966 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:00.921331 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:00.924134 (+ 2803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:00.925031 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:00.925230 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:00.930430 (+ 5200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:00.930439 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:00.930452 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:00.930485 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:00.934077 (+ 3592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:00.934835 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:00.934849 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:00.934851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:00.935000 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:00.935390 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:00.935395 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:00.935400 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:00.935987 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:00.936205 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:00.936818 (+ 613us) server_negotiation.cc:299] Negotiation successful
0924 12:59:00.937203 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":653,"thread_start_us":418,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.125@KRBTEST.COM" created.
I20260924 12:59:00.943666 1472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:59:00.945699 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:00.944890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50480)
0924 12:59:00.945241 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:00.945506 (+ 265us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206}
W20260924 12:59:00.946105 1424 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
I20260924 12:59:00.949198 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:00.948598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50492)
0924 12:59:00.948866 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:00.948961 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
W20260924 12:59:00.949509 1472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:41197: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab.
Entry for principal kudu/127.11.49.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab.
I20260924 12:59:00.976889 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.125:41197
--webserver_interface=127.11.49.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab
--principal=kudu/127.11.49.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:35107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:33777,127.11.49.125:41197,127.11.49.124:41751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:59:00.999049 1472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } attempt: 1
I20260924 12:59:01.000257 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:00.999785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50500)
0924 12:59:01.000000 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.000128 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260924 12:59:01.001754 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.001345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50502)
0924 12:59:01.001516 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.001592 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260924 12:59:01.002161 1472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:41197: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
I20260924 12:59:01.070466 1472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } attempt: 2
I20260924 12:59:01.072177 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.071563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50508)
0924 12:59:01.071839 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.072024 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260924 12:59:01.073442 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.073037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50524)
0924 12:59:01.073203 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.073285 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260924 12:59:01.073707 1472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:41197: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
I20260924 12:59:01.165004 1472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } attempt: 3
I20260924 12:59:01.166224 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.165777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50528)
0924 12:59:01.165983 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.166085 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260924 12:59:01.167348 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.166973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50534)
0924 12:59:01.167128 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.167205 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260924 12:59:01.167692 1472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:41197: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
I20260924 12:59:01.311014 1472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } attempt: 4
I20260924 12:59:01.312320 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.311726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50550)
0924 12:59:01.312045 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.312131 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
I20260924 12:59:01.313329 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.312981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50552)
0924 12:59:01.313123 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.313212 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260924 12:59:01.313551 1472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:41197: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41197: connect: Connection refused (error 111)
W20260924 12:59:01.406574 1479 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 12:59:01.407073 1479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:59:01.407263 1479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:59:01.407400 1479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:59:01.416507 1479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:59:01.416669 1479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:59:01.416766 1479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:59:01.416872 1479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:59:01.416988 1479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:59:01.430142 1479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:35107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:33777,127.11.49.125:41197,127.11.49.124:41751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab
--principal=kudu/127.11.49.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.125:41197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.49.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:59:01.431958 1479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:59:01.433698 1479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:59:01.448967 1487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:01.449016 1484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:01.449082 1485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:59:01.450192 1479 server_base.cc:1034] running on GCE node
I20260924 12:59:01.451282 1479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:59:01.453205 1479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:59:01.454460 1479 hybrid_clock.cc:648] HybridClock initialized: now 1790254741454388 us; error 53 us; skew 500 ppm
I20260924 12:59:01.454908 1479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:59:01 dist-test-slave-m9hg krb5kdc[1392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254741, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:59:01.462255 1479 init.cc:377] Logged in from keytab as kudu/127.11.49.125@KRBTEST.COM (short username kudu)
I20260924 12:59:01.464551 1479 webserver.cc:460] Webserver started at http://127.11.49.125:39635/ using document root <none> and password file <none>
I20260924 12:59:01.465523 1479 fs_manager.cc:359] Metadata directory not provided
I20260924 12:59:01.465642 1479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:59:01.466074 1479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:59:01.470052 1479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/data/instance:
uuid: "8ccf9f87456a451fac7c69ae0d47d753"
format_stamp: "Formatted at 2026-09-24 12:59:01 on dist-test-slave-m9hg"
server_key: "c8d4b1d13ed784b79b62fdb162bfe145"
server_key_iv: "66104247c754c8946abaa1626fcf4553"
server_key_version: "encryptionkey@0"
I20260924 12:59:01.471117 1479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/wal/instance:
uuid: "8ccf9f87456a451fac7c69ae0d47d753"
format_stamp: "Formatted at 2026-09-24 12:59:01 on dist-test-slave-m9hg"
server_key: "c8d4b1d13ed784b79b62fdb162bfe145"
server_key_iv: "66104247c754c8946abaa1626fcf4553"
server_key_version: "encryptionkey@0"
I20260924 12:59:01.478004 1479 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260924 12:59:01.483091 1494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:59:01.485004 1479 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:59:01.485321 1479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/wal
uuid: "8ccf9f87456a451fac7c69ae0d47d753"
format_stamp: "Formatted at 2026-09-24 12:59:01 on dist-test-slave-m9hg"
server_key: "c8d4b1d13ed784b79b62fdb162bfe145"
server_key_iv: "66104247c754c8946abaa1626fcf4553"
server_key_version: "encryptionkey@0"
I20260924 12:59:01.485620 1479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:59:01.504127 1479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:59:01.509775 1479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:59:01.510154 1479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:59:01.533488 1479 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.125:41197
I20260924 12:59:01.533540 1545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.125:41197 every 8 connection(s)
I20260924 12:59:01.535329 1479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
I20260924 12:59:01.539806 1546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:59:01.541383 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 1479
I20260924 12:59:01.541597 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-1/wal/instance
I20260924 12:59:01.542199 11461 external_mini_cluster.cc:1428] Setting key e2fe9bfb14fdae9db148d79b4895cb6f
I20260924 12:59:01.551004 1546 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:59:01 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254741, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.49.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.124@KRBTEST.COM" created.
I20260924 12:59:01.581193 1549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.555284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47972 (local address 127.11.49.126:33777)
0924 12:59:01.556866 (+ 1582us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:01.556876 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:01.557932 (+ 1056us) server_negotiation.cc:407] Connection header received
0924 12:59:01.560424 (+ 2492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:01.560431 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:01.560559 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:01.560698 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:01.562818 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.563633 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.565951 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.566470 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.566639 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:01.572017 (+ 5378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:01.572024 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:01.572028 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:01.572089 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:01.576032 (+ 3943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:01.577539 (+ 1507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:01.577547 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:01.577550 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:01.577778 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:01.578508 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:01.578512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:01.578514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:01.578878 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:01.579036 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:01.580611 (+ 1575us) server_negotiation.cc:299] Negotiation successful
0924 12:59:01.580868 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1299,"thread_start_us":1089,"threads_started":1}
I20260924 12:59:01.583331 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.556338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:33777 (local address 127.0.0.1:47972)
0924 12:59:01.557630 (+ 1292us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.557703 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:01.559980 (+ 2277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:01.561023 (+ 1043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:01.561035 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:01.561747 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:01.562519 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:01.562542 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.563834 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.563838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:01.565721 (+ 1883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:01.565748 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.566787 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.566796 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:01.567102 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:01.568156 (+ 1054us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:01.568187 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:01.571629 (+ 3442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:01.576360 (+ 4731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:01.576380 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:01.576417 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:01.577263 (+ 846us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:01.577957 (+ 694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:01.577966 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:01.577974 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:01.578325 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:01.579051 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:01.579065 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:01.579729 (+ 664us) client_negotiation.cc:769] Sending connection context
0924 12:59:01.580443 (+ 714us) client_negotiation.cc:240] Negotiation successful
0924 12:59:01.581377 (+ 934us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":903,"thread_start_us":580,"threads_started":1}
I20260924 12:59:01.598271 1546 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:59:01 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254741, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
I20260924 12:59:01.612861 1472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } attempt: 5
I20260924 12:59:01.620746 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.599453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50554)
0924 12:59:01.599760 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.599778 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:01.599891 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:01.601754 (+ 1863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:01.601759 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:01.602319 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:01.602640 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:01.602654 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.605119 (+ 2465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.605124 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:01.606581 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:01.606597 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.607895 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.607901 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:01.608097 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:01.608889 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:01.608913 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:01.612110 (+ 3197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:01.617367 (+ 5257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:01.617374 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:01.617378 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:01.617922 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:01.618470 (+ 548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:01.618478 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:01.618484 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:01.618687 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:01.619679 (+ 992us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:01.619683 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:01.619822 (+ 139us) client_negotiation.cc:769] Sending connection context
0924 12:59:01.619977 (+ 155us) client_negotiation.cc:240] Negotiation successful
0924 12:59:01.620303 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167}
I20260924 12:59:01.622119 1552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.600379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50554 (local address 127.11.49.125:41197)
0924 12:59:01.601151 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:01.601161 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:01.601196 (+ 35us) server_negotiation.cc:407] Connection header received
0924 12:59:01.601264 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:01.601273 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:01.601566 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:01.602849 (+ 1283us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:01.603150 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.604954 (+ 1804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.606797 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.607717 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.608506 (+ 789us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:01.612393 (+ 3887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:01.612412 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:01.612437 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:01.612492 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:01.617201 (+ 4709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:01.618131 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:01.618144 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:01.618151 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:01.618330 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:01.618815 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:01.618821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:01.618826 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:01.619379 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:01.619609 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:01.621344 (+ 1735us) server_negotiation.cc:299] Negotiation successful
0924 12:59:01.621636 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":421,"threads_started":1}
I20260924 12:59:01.626605 1546 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:59:01.628317 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.627560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57494)
0924 12:59:01.627908 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.628066 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207}
W20260924 12:59:01.628657 1495 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Sep 24 12:59:01 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254740, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
I20260924 12:59:01.631196 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.630704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57500)
0924 12:59:01.630963 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.631065 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
W20260924 12:59:01.631516 1546 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:41751: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab.
Entry for principal kudu/127.11.49.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab.
I20260924 12:59:01.637126 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.124:41751
--webserver_interface=127.11.49.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab
--principal=kudu/127.11.49.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:35107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:33777,127.11.49.125:41197,127.11.49.124:41751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:59:01.637966 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.613780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50568)
0924 12:59:01.614021 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.614047 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:01.614192 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:01.617888 (+ 3696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:01.617898 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:01.618614 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:01.618957 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:01.618977 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.620713 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.620724 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:01.622467 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:01.622502 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.623639 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.623650 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:01.625800 (+ 2150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:01.627056 (+ 1256us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:01.627089 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:01.630935 (+ 3846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:01.634966 (+ 4031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:01.634973 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:01.634977 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:01.635423 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:01.635832 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:01.635837 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:01.635841 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:01.635981 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:01.636762 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:01.636768 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:01.637003 (+ 235us) client_negotiation.cc:769] Sending connection context
0924 12:59:01.637196 (+ 193us) client_negotiation.cc:240] Negotiation successful
0924 12:59:01.637650 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260924 12:59:01.638150 1553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.613847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50568 (local address 127.11.49.125:41197)
0924 12:59:01.617404 (+ 3557us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:01.617410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:01.617438 (+ 28us) server_negotiation.cc:407] Connection header received
0924 12:59:01.617499 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:01.617504 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:01.617588 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:01.617699 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:01.619179 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.620512 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.622687 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:01.623393 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:01.623530 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:01.631368 (+ 7838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:01.631378 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:01.631385 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:01.631430 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:01.634774 (+ 3344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:01.635552 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:01.635559 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:01.635563 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:01.635691 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:01.636086 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:01.636093 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:01.636096 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:01.636499 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:01.636653 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:01.637356 (+ 703us) server_negotiation.cc:299] Negotiation successful
0924 12:59:01.637618 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1189,"thread_start_us":969,"threads_started":1}
I20260924 12:59:01.639351 1472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:59:01.640877 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.640263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57510)
0924 12:59:01.640574 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.640688 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260924 12:59:01.642138 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.641756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57516)
0924 12:59:01.641914 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.642014 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260924 12:59:01.642422 1472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:41751: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
I20260924 12:59:01.681234 1546 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } attempt: 1
I20260924 12:59:01.682827 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.682221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57530)
0924 12:59:01.682487 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.682624 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260924 12:59:01.684372 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.683630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57532)
0924 12:59:01.683823 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.684111 (+ 288us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260924 12:59:01.684708 1546 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:41751: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
I20260924 12:59:01.693706 1472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } attempt: 1
I20260924 12:59:01.695401 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.694652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57546)
0924 12:59:01.694955 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.695128 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260924 12:59:01.697258 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.696617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57562)
0924 12:59:01.696862 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.697022 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260924 12:59:01.697597 1472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:41751: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
I20260924 12:59:01.753000 1546 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } attempt: 2
I20260924 12:59:01.754765 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.753980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57570)
0924 12:59:01.754324 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.754495 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260924 12:59:01.756497 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.755639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57576)
0924 12:59:01.756069 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.756211 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
W20260924 12:59:01.756871 1546 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:41751: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
I20260924 12:59:01.765892 1472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } attempt: 2
I20260924 12:59:01.768020 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.766846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57582)
0924 12:59:01.767509 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.767676 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260924 12:59:01.769568 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.769016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57594)
0924 12:59:01.769252 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.769378 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260924 12:59:01.769891 1472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:41751: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
I20260924 12:59:01.848210 1546 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } attempt: 3
I20260924 12:59:01.849908 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.849255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57606)
0924 12:59:01.849578 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.849711 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260924 12:59:01.851333 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.850862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57616)
0924 12:59:01.851117 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.851211 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
W20260924 12:59:01.851630 1546 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:41751: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
I20260924 12:59:01.876248 1472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } attempt: 3
I20260924 12:59:01.878088 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.877286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57622)
0924 12:59:01.877614 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.877780 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260924 12:59:01.879807 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.879178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57638)
0924 12:59:01.879441 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.879601 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
W20260924 12:59:01.880230 1472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:41751: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
I20260924 12:59:01.994881 1546 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } attempt: 4
I20260924 12:59:01.996583 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.995834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57644)
0924 12:59:01.996117 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.996240 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260924 12:59:01.997934 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:01.997534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57660)
0924 12:59:01.997743 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:01.997817 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260924 12:59:01.998183 1546 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:41751: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
I20260924 12:59:02.057595 1472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } attempt: 4
I20260924 12:59:02.059374 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.058621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57668)
0924 12:59:02.058957 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:02.059126 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260924 12:59:02.060922 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.060376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57674)
0924 12:59:02.060584 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:02.060714 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260924 12:59:02.061228 1472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:41751: Network error: Client connection negotiation failed: client connection to 127.11.49.124:41751: connect: Connection refused (error 111)
W20260924 12:59:02.094254 1555 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 12:59:02.094746 1555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:59:02.094833 1555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:59:02.094929 1555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:59:02.103441 1555 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:59:02.103600 1555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:59:02.103665 1555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:59:02.103719 1555 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:59:02.103793 1555 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:59:02.115767 1555 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:35107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:33777,127.11.49.125:41197,127.11.49.124:41751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab
--principal=kudu/127.11.49.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.124:41751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.49.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:59:02.117551 1555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:59:02.119254 1555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:59:02.135723 1560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:02.135766 1561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:02.135756 1563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:59:02.141950 1555 server_base.cc:1034] running on GCE node
I20260924 12:59:02.142957 1555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:59:02.144769 1555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:59:02.148201 1555 hybrid_clock.cc:648] HybridClock initialized: now 1790254742148080 us; error 79 us; skew 500 ppm
I20260924 12:59:02.148726 1555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:59:02 dist-test-slave-m9hg krb5kdc[1392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254742, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:59:02.152884 1555 init.cc:377] Logged in from keytab as kudu/127.11.49.124@KRBTEST.COM (short username kudu)
I20260924 12:59:02.154938 1555 webserver.cc:460] Webserver started at http://127.11.49.124:43901/ using document root <none> and password file <none>
I20260924 12:59:02.155819 1555 fs_manager.cc:359] Metadata directory not provided
I20260924 12:59:02.155922 1555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:59:02.156332 1555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:59:02.159960 1555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/data/instance:
uuid: "1743f08495944129bf0caaa2f938b57b"
format_stamp: "Formatted at 2026-09-24 12:59:02 on dist-test-slave-m9hg"
server_key: "56d9f98daaeab22ae97e7a8da0ef33d9"
server_key_iv: "df054a7df46ac582fd7ef12dde8bb709"
server_key_version: "encryptionkey@0"
I20260924 12:59:02.161041 1555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/wal/instance:
uuid: "1743f08495944129bf0caaa2f938b57b"
format_stamp: "Formatted at 2026-09-24 12:59:02 on dist-test-slave-m9hg"
server_key: "56d9f98daaeab22ae97e7a8da0ef33d9"
server_key_iv: "df054a7df46ac582fd7ef12dde8bb709"
server_key_version: "encryptionkey@0"
I20260924 12:59:02.167862 1555 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260924 12:59:02.172657 1570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:59:02.174484 1555 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 12:59:02.174723 1555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/wal
uuid: "1743f08495944129bf0caaa2f938b57b"
format_stamp: "Formatted at 2026-09-24 12:59:02 on dist-test-slave-m9hg"
server_key: "56d9f98daaeab22ae97e7a8da0ef33d9"
server_key_iv: "df054a7df46ac582fd7ef12dde8bb709"
server_key_version: "encryptionkey@0"
I20260924 12:59:02.175031 1555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:59:02.240226 1555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:59:02.246097 1555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:59:02.246426 1555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:59:02.268981 1555 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.124:41751
I20260924 12:59:02.269007 1621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.124:41751 every 8 connection(s)
I20260924 12:59:02.270444 1555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
I20260924 12:59:02.275596 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 1555
I20260924 12:59:02.275836 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790254326970360-11461-0/minicluster-data/master-2/wal/instance
I20260924 12:59:02.275923 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:59:02.276422 11461 external_mini_cluster.cc:1428] Setting key 7cf3d3a780c09800c35450a78ac519f3
I20260924 12:59:02.289474 1622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:59:02 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
I20260924 12:59:02.297452 1546 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } attempt: 5
Sep 24 12:59:02 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254742, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
Sep 24 12:59:02 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254741, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
I20260924 12:59:02.308684 1625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.278969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57676 (local address 127.11.49.124:41751)
0924 12:59:02.280175 (+ 1206us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.280198 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.280324 (+ 126us) server_negotiation.cc:407] Connection header received
0924 12:59:02.282611 (+ 2287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.282656 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.283431 (+ 775us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.284110 (+ 679us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.285943 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.288197 (+ 2254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.289931 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.291223 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.291516 (+ 293us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.297174 (+ 5658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:02.297185 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:02.297198 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:02.297269 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:02.302213 (+ 4944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.303387 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.303397 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.303407 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.303619 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.304297 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.304304 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.304308 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.305209 (+ 901us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:02.305571 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:02.306272 (+ 701us) server_negotiation.cc:299] Negotiation successful
0924 12:59:02.307082 (+ 810us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":782,"thread_start_us":474,"threads_started":1}
I20260924 12:59:02.313325 1627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.293747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:33777 (local address 127.0.0.1:47988)
0924 12:59:02.294970 (+ 1223us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:02.295027 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:02.295299 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:02.295804 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:02.295811 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:02.296739 (+ 928us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:02.297116 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:02.297131 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.298641 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.298650 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:02.300759 (+ 2109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:02.300773 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.301689 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.301696 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:02.302066 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.302917 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:02.302941 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:02.305873 (+ 2932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:02.309989 (+ 4116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:02.310010 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:02.310019 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:02.310667 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:02.311063 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:02.311068 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:02.311072 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:02.311327 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:02.311903 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:02.311912 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:02.312110 (+ 198us) client_negotiation.cc:769] Sending connection context
0924 12:59:02.312368 (+ 258us) client_negotiation.cc:240] Negotiation successful
0924 12:59:02.312854 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":924,"mutex_wait_us":59,"thread_start_us":723,"threads_started":1}
I20260924 12:59:02.313666 1626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.293709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47988 (local address 127.11.49.126:33777)
0924 12:59:02.294508 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.294517 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.295168 (+ 651us) server_negotiation.cc:407] Connection header received
0924 12:59:02.295468 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.295474 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.295568 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.295712 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.297314 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.298385 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.300967 (+ 2582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.301426 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.301591 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.306186 (+ 4595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:02.306194 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:02.306199 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:02.306248 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:02.309827 (+ 3579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.310802 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.310808 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.310811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.310950 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.311451 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.311456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.311459 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.311763 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:02.311932 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:02.312980 (+ 1048us) server_negotiation.cc:299] Negotiation successful
0924 12:59:02.313228 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":427,"threads_started":1}
I20260924 12:59:02.316627 1622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:59:02.318976 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.298234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57682)
0924 12:59:02.298600 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:02.298626 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:02.298749 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:02.299947 (+ 1198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:02.299956 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:02.300487 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:02.300734 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:02.300749 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.302829 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.302836 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:02.304171 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:02.304196 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.305194 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.305201 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:02.305424 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.306188 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:02.306228 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:02.309119 (+ 2891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:02.315331 (+ 6212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:02.315339 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:02.315346 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:02.316082 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:02.316855 (+ 773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:02.316861 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:02.316864 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:02.317099 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:02.317843 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:02.317849 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:02.318140 (+ 291us) client_negotiation.cc:769] Sending connection context
0924 12:59:02.318270 (+ 130us) client_negotiation.cc:240] Negotiation successful
0924 12:59:02.318666 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207}
I20260924 12:59:02.320050 1628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.298432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57682 (local address 127.11.49.124:41751)
0924 12:59:02.299496 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.299502 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.299529 (+ 27us) server_negotiation.cc:407] Connection header received
0924 12:59:02.299590 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.299596 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.299691 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.299827 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.301037 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.302608 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.304423 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.304954 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.305175 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.309432 (+ 4257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:02.309442 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:02.309447 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:02.309497 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:02.315102 (+ 5605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.316492 (+ 1390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.316497 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.316499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.316688 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.317266 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.317272 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.317276 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.317682 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:02.319422 (+ 1740us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:02.319542 (+ 120us) server_negotiation.cc:299] Negotiation successful
0924 12:59:02.319741 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":888,"thread_start_us":599,"threads_started":1}
Sep 24 12:59:02 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:59:02.327157 1546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753: Bootstrap starting.
Sep 24 12:59:02 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254742, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
I20260924 12:59:02.330870 1546 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753: Neither blocks nor log segments found. Creating new log.
I20260924 12:59:02.332429 1546 log.cc:824] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753: Log is configured to *not* fsync() on all Append() calls
I20260924 12:59:02.335373 1629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.313900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48000 (local address 127.11.49.126:33777)
0924 12:59:02.314684 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.314689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.314717 (+ 28us) server_negotiation.cc:407] Connection header received
0924 12:59:02.314931 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.314936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.315012 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.315126 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.317106 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.318416 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.321143 (+ 2727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.321823 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.321993 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.327255 (+ 5262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:02.327270 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:02.327279 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:02.327340 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:02.331400 (+ 4060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.332594 (+ 1194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.332599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.332602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.332758 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.333176 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.333186 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.333188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.333507 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:02.333880 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:02.334545 (+ 665us) server_negotiation.cc:299] Negotiation successful
0924 12:59:02.334845 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":335,"threads_started":1}
I20260924 12:59:02.338490 1472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } attempt: 5
I20260924 12:59:02.340143 1627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.317621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41197 (local address 127.0.0.1:50584)
0924 12:59:02.317961 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:02.317986 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:02.318123 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:02.321482 (+ 3359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:02.321487 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:02.321977 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:02.322176 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:02.322189 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.323771 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.323779 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:02.325231 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:02.325247 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.326362 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.326372 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:02.326665 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.327548 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:02.327574 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:02.330927 (+ 3353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:02.335816 (+ 4889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:02.335823 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:02.335826 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:02.336499 (+ 673us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:02.337065 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:02.337075 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:02.337082 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:02.337405 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:02.338917 (+ 1512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:02.338925 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:02.339150 (+ 225us) client_negotiation.cc:769] Sending connection context
0924 12:59:02.339303 (+ 153us) client_negotiation.cc:240] Negotiation successful
0924 12:59:02.339711 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192}
I20260924 12:59:02.341454 1630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.317713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50584 (local address 127.11.49.125:41197)
0924 12:59:02.321130 (+ 3417us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.321136 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.321158 (+ 22us) server_negotiation.cc:407] Connection header received
0924 12:59:02.321221 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.321225 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.321320 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.321447 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.322365 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.323598 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.325462 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.326085 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.326231 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.331272 (+ 5041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:02.331281 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:02.331288 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:02.331349 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:02.335577 (+ 4228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.336625 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.336632 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.336638 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.336839 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.338101 (+ 1262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.338109 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.338116 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.338740 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:02.340504 (+ 1764us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:02.340684 (+ 180us) server_negotiation.cc:299] Negotiation successful
0924 12:59:02.340953 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3269,"thread_start_us":3086,"threads_started":1}
I20260924 12:59:02.343461 1622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:59:02.347608 1546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753: No bootstrap required, opened a new log
Sep 24 12:59:02 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254740, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
Sep 24 12:59:02 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254742, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
Sep 24 12:59:02 dist-test-slave-m9hg krb5kdc[1392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
I20260924 12:59:02.360028 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.339150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57690)
0924 12:59:02.339543 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:02.339566 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:02.339684 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:02.341170 (+ 1486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:02.341179 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:02.341830 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:02.342104 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:02.342118 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.343781 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.343789 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:02.345496 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:02.345518 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.347159 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.347166 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:02.347396 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.348219 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:02.348248 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:02.351372 (+ 3124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:02.356223 (+ 4851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:02.356229 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:02.356234 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:02.356860 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:02.357359 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:02.357363 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:02.357376 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:02.357579 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:02.358951 (+ 1372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:02.358956 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:02.359138 (+ 182us) client_negotiation.cc:769] Sending connection context
0924 12:59:02.359281 (+ 143us) client_negotiation.cc:240] Negotiation successful
0924 12:59:02.359590 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260}
I20260924 12:59:02.360445 1546 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } }
I20260924 12:59:02.360985 1546 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ccf9f87456a451fac7c69ae0d47d753, State: Initialized, Role: FOLLOWER
I20260924 12:59:02.361449 1628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.339914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57690 (local address 127.11.49.124:41751)
0924 12:59:02.340540 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.340550 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.340585 (+ 35us) server_negotiation.cc:407] Connection header received
0924 12:59:02.340676 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.340685 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.340806 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.341083 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.342296 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.343535 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.345730 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.346708 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.346898 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.351711 (+ 4813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:02.351719 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:02.351724 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:02.351777 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:02.356022 (+ 4245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.357019 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.357026 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.357032 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.357219 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.357714 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.357720 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.357725 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.358722 (+ 997us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:02.358886 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:02.360628 (+ 1742us) server_negotiation.cc:299] Negotiation successful
0924 12:59:02.361045 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":384}
I20260924 12:59:02.361696 1546 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } }
I20260924 12:59:02.365979 1625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.345449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57704 (local address 127.11.49.124:41751)
0924 12:59:02.345630 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.345637 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.345657 (+ 20us) server_negotiation.cc:407] Connection header received
0924 12:59:02.345705 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.345712 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.345816 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.345908 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.347299 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.348410 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.350437 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.351159 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.351309 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.356977 (+ 5668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:02.356984 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:02.356988 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:02.357031 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:02.361857 (+ 4826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.362877 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.362882 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.362887 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.363035 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.363498 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.363505 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.363507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.363963 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:02.365272 (+ 1309us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:02.365395 (+ 123us) server_negotiation.cc:299] Negotiation successful
0924 12:59:02.365624 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260924 12:59:02.366004 1630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.337994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50590 (local address 127.11.49.125:41197)
0924 12:59:02.342047 (+ 4053us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.342054 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.342074 (+ 20us) server_negotiation.cc:407] Connection header received
0924 12:59:02.342130 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.342135 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.342263 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.342365 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.345182 (+ 2817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.346522 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.349034 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.349827 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.349952 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.357293 (+ 7341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:02.357300 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:02.357305 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:02.357357 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:02.362078 (+ 4721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.363235 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.363243 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.363247 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.363411 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.363914 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.363920 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.363923 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.364392 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:02.364691 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:02.365326 (+ 635us) server_negotiation.cc:299] Negotiation successful
0924 12:59:02.365614 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3919,"thread_start_us":4665,"threads_started":1}
I20260924 12:59:02.366670 1627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.344735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:41751 (local address 127.0.0.1:57704)
0924 12:59:02.345105 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:02.345130 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:02.345246 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:02.346169 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:02.346174 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:02.346927 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:02.347141 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:02.347151 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.348824 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.348829 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:02.350265 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:02.350280 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.351576 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.351582 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:02.351849 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.352645 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:02.352669 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:02.356723 (+ 4054us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:02.362091 (+ 5368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:02.362096 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:02.362101 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:02.362721 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:02.363194 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:02.363202 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:02.363205 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:02.363375 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:02.364157 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:02.364162 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:02.364354 (+ 192us) client_negotiation.cc:769] Sending connection context
0924 12:59:02.364505 (+ 151us) client_negotiation.cc:240] Negotiation successful
0924 12:59:02.364876 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214}
I20260924 12:59:02.369853 1472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b: Bootstrap starting.
I20260924 12:59:02.373172 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:59:02.373816 1622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b: Bootstrap starting.
I20260924 12:59:02.376371 1472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b: Neither blocks nor log segments found. Creating new log.
I20260924 12:59:02.378549 1622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b: Neither blocks nor log segments found. Creating new log.
I20260924 12:59:02.379271 1472 log.cc:824] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b: Log is configured to *not* fsync() on all Append() calls
I20260924 12:59:02.380475 1622 log.cc:824] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b: Log is configured to *not* fsync() on all Append() calls
I20260924 12:59:02.380856 1633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } } }
I20260924 12:59:02.381963 1633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:02.382469 1546 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:59:02.377537 1447 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "49b994b3bf494993bfef75289df36f8b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48000
I20260924 12:59:02.389415 1472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b: No bootstrap required, opened a new log
I20260924 12:59:02.390540 1622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b: No bootstrap required, opened a new log
I20260924 12:59:02.400533 1472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } }
I20260924 12:59:02.401131 1472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49b994b3bf494993bfef75289df36f8b, State: Initialized, Role: FOLLOWER
I20260924 12:59:02.401849 1472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } }
I20260924 12:59:02.403117 1622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } }
I20260924 12:59:02.403709 1622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1743f08495944129bf0caaa2f938b57b, State: Initialized, Role: FOLLOWER
I20260924 12:59:02.403748 1640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } } }
I20260924 12:59:02.404395 1622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } }
I20260924 12:59:02.405002 1640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:02.405296 1472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:59:02.405445 1447 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260924 12:59:02.405754 1447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:59:02.411795 1447 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } }
I20260924 12:59:02.416965 1521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "49b994b3bf494993bfef75289df36f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8ccf9f87456a451fac7c69ae0d47d753"
I20260924 12:59:02.418001 1521 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:59:02.423975 1521 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49b994b3bf494993bfef75289df36f8b in term 1.
I20260924 12:59:02.425498 1424 leader_election.cc:302] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49b994b3bf494993bfef75289df36f8b, 8ccf9f87456a451fac7c69ae0d47d753; no voters:
I20260924 12:59:02.431104 1640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 12:59:02.435006 1447 leader_election.cc:288] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [CANDIDATE]: Term 1 election: Requested vote from peers 8ccf9f87456a451fac7c69ae0d47d753 (127.11.49.125:41197), 1743f08495944129bf0caaa2f938b57b (127.11.49.124:41751)
I20260924 12:59:02.434816 1640 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [term 1 LEADER]: Becoming Leader. State: Replica: 49b994b3bf494993bfef75289df36f8b, State: Running, Role: LEADER
I20260924 12:59:02.451745 1657 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260924 12:59:02.454613 1640 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } }
I20260924 12:59:02.464974 1479 master_runner.cc:186] Error getting master registration for 127.11.49.126:33777: OK, instance_id { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" instance_seqno: 1790254740885126 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 12:59:02.476977 1479 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260924 12:59:02.478818 1651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49b994b3bf494993bfef75289df36f8b. Latest consensus state: current_term: 1 leader_uuid: "49b994b3bf494993bfef75289df36f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } } }
I20260924 12:59:02.484561 1651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [sys.catalog]: This master's current role is: LEADER
W20260924 12:59:02.489383 1668 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260924 12:59:02.495507 1642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } } }
I20260924 12:59:02.497467 1622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [sys.catalog]: configured and running, proceeding with master startup.
W20260924 12:59:02.499279 1576 tablet.cc:2369] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:59:02.503520 1642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:02.500523 1597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "49b994b3bf494993bfef75289df36f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1743f08495944129bf0caaa2f938b57b"
W20260924 12:59:02.503767 1668 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 12:59:02.503937 1669 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:59:02.503893 1597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:59:02.506635 1669 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:59:02.507881 1597 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49b994b3bf494993bfef75289df36f8b in term 1.
I20260924 12:59:02.502709 1628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.468521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57708 (local address 127.11.49.124:41751)
0924 12:59:02.468732 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.468738 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.469601 (+ 863us) server_negotiation.cc:407] Connection header received
0924 12:59:02.469942 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.469948 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.470057 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.470139 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.473025 (+ 2886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.474274 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.476452 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.477194 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.477319 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.481912 (+ 4593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:02.481919 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:02.481924 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:02.481975 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:02.487006 (+ 5031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.499338 (+ 12332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.499345 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.499349 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.499571 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.500163 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.500172 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.500177 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.500757 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:02.501159 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:02.501974 (+ 815us) server_negotiation.cc:299] Negotiation successful
0924 12:59:02.502297 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260924 12:59:02.513564 1500 tablet.cc:2369] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 12:59:02.494339 1405 master_runner.cc:186] Error getting master registration for 127.11.49.124:41751: OK, instance_id { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" instance_seqno: 1790254742262486 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 12:59:02.528373 1405 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260924 12:59:02.529968 1629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.469440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48016 (local address 127.11.49.126:33777)
0924 12:59:02.469735 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.469745 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.483578 (+ 13833us) server_negotiation.cc:407] Connection header received
0924 12:59:02.483884 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.483892 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.484005 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.484091 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.496118 (+ 12027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.497359 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.510329 (+ 12970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.510953 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.511043 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.518218 (+ 7175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:02.518229 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:02.518237 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:02.518300 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:02.523230 (+ 4930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.524501 (+ 1271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.524510 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.524516 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.524715 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.525262 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.525270 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.525275 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.525815 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:02.526155 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:02.529186 (+ 3031us) server_negotiation.cc:299] Negotiation successful
0924 12:59:02.529465 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260924 12:59:02.536113 1630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:02.471421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.11.49.125:41197)
0924 12:59:02.471728 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.471743 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.490161 (+ 18418us) server_negotiation.cc:407] Connection header received
0924 12:59:02.492214 (+ 2053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.492220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.492330 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.492406 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.500113 (+ 7707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.501194 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.511906 (+ 10712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:02.512659 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:02.512775 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:02.526909 (+ 14134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:02.526920 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:02.526928 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:02.526994 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:02.531496 (+ 4502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.532471 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.532478 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.532481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.532639 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:02.533105 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:02.533110 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:02.533114 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:02.533528 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:02.533774 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:02.535452 (+ 1678us) server_negotiation.cc:299] Negotiation successful
0924 12:59:02.535746 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260924 12:59:02.548723 1521 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [term 1 FOLLOWER]: Refusing update from remote peer 49b994b3bf494993bfef75289df36f8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:59:02.549687 1597 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [term 1 FOLLOWER]: Refusing update from remote peer 49b994b3bf494993bfef75289df36f8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:59:02.551280 1651 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:59:02.552002 1651 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:59:02.573482 1633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49b994b3bf494993bfef75289df36f8b. Latest consensus state: current_term: 1 leader_uuid: "49b994b3bf494993bfef75289df36f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } } }
I20260924 12:59:02.573946 1633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:02.586289 1633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "49b994b3bf494993bfef75289df36f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } } }
I20260924 12:59:02.588162 1633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:02.588358 1642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49b994b3bf494993bfef75289df36f8b. Latest consensus state: current_term: 1 leader_uuid: "49b994b3bf494993bfef75289df36f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } } }
I20260924 12:59:02.588819 1642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:02.592381 1669 catalog_manager.cc:1347] Generated new cluster ID: c88b3b210d8e4c8d8024ba034b98c164
I20260924 12:59:02.592478 1669 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:59:02.592253 1651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "49b994b3bf494993bfef75289df36f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } } }
I20260924 12:59:02.592592 1651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [sys.catalog]: This master's current role is: LEADER
I20260924 12:59:02.592943 1651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "49b994b3bf494993bfef75289df36f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } } }
I20260924 12:59:02.593176 1651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b [sys.catalog]: This master's current role is: LEADER
I20260924 12:59:02.603524 1642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "49b994b3bf494993bfef75289df36f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b994b3bf494993bfef75289df36f8b" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 33777 } } peers { permanent_uuid: "8ccf9f87456a451fac7c69ae0d47d753" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41197 } } peers { permanent_uuid: "1743f08495944129bf0caaa2f938b57b" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 41751 } } }
I20260924 12:59:02.605319 1642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:02.623302 1669 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:59:02.625639 1669 catalog_manager.cc:1504] Loading token signing keys...
W20260924 12:59:02.627782 1688 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 12:59:02.627964 1688 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 12:59:02.646375 1669 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49b994b3bf494993bfef75289df36f8b: Generated new TSK 0
I20260924 12:59:02.647987 1669 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260924 12:59:02.751327 1629 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:02.742907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48028 (local address 127.11.49.126:33777)
0924 12:59:02.743290 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.743298 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.749034 (+ 5736us) server_negotiation.cc:407] Connection header received
0924 12:59:02.749366 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.749375 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.749503 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.749582 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.750963 (+ 1381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48028: BlockingRecv error: recv got EOF from 127.0.0.1:48028 (error 108)
Metrics: {"server-negotiator.queue_time_us":247}
W20260924 12:59:02.752959 1628 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:02.743092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57714 (local address 127.11.49.124:41751)
0924 12:59:02.743429 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.743435 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.749229 (+ 5794us) server_negotiation.cc:407] Connection header received
0924 12:59:02.749468 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.749477 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.749563 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.749628 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.752673 (+ 3045us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57714: BlockingRecv error: recv got EOF from 127.0.0.1:57714 (error 108)
Metrics: {"server-negotiator.queue_time_us":226}
W20260924 12:59:02.755931 1630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:02.748878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50606 (local address 127.11.49.125:41197)
0924 12:59:02.749193 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.749201 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.753781 (+ 4580us) server_negotiation.cc:407] Connection header received
0924 12:59:02.754523 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.754528 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.754627 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.754701 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.755678 (+ 977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50606: BlockingRecv error: recv got EOF from 127.0.0.1:50606 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
W20260924 12:59:02.766521 1630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:02.763094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50608 (local address 127.11.49.125:41197)
0924 12:59:02.763289 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.763295 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.763916 (+ 621us) server_negotiation.cc:407] Connection header received
0924 12:59:02.764192 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.764202 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.764417 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.764605 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.766189 (+ 1584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50608: BlockingRecv error: recv got EOF from 127.0.0.1:50608 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260924 12:59:02.773861 1630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:02.771189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50620 (local address 127.11.49.125:41197)
0924 12:59:02.771383 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.771391 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.772082 (+ 691us) server_negotiation.cc:407] Connection header received
0924 12:59:02.772290 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.772297 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.772455 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.772607 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.773571 (+ 964us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50620: BlockingRecv error: recv got EOF from 127.0.0.1:50620 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260924 12:59:02.787992 1630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:02.785332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50632 (local address 127.11.49.125:41197)
0924 12:59:02.785527 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.785533 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.786154 (+ 621us) server_negotiation.cc:407] Connection header received
0924 12:59:02.786382 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.786390 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.786529 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.786680 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.787638 (+ 958us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50632: BlockingRecv error: recv got EOF from 127.0.0.1:50632 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260924 12:59:02.801700 1630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:02.798611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50642 (local address 127.11.49.125:41197)
0924 12:59:02.798900 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.798907 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.799530 (+ 623us) server_negotiation.cc:407] Connection header received
0924 12:59:02.799749 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.799757 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.799887 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.800062 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.801440 (+ 1378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50642: BlockingRecv error: recv got EOF from 127.0.0.1:50642 (error 108)
Metrics: {"server-negotiator.queue_time_us":122}
W20260924 12:59:02.817273 1630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:02.814537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50646 (local address 127.11.49.125:41197)
0924 12:59:02.814784 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.814792 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.815502 (+ 710us) server_negotiation.cc:407] Connection header received
0924 12:59:02.815744 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.815750 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.815870 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.816009 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.817030 (+ 1021us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50646: BlockingRecv error: recv got EOF from 127.0.0.1:50646 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260924 12:59:02.840566 1630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:02.837752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50662 (local address 127.11.49.125:41197)
0924 12:59:02.838013 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.838021 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.838734 (+ 713us) server_negotiation.cc:407] Connection header received
0924 12:59:02.838979 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.838985 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.839101 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.839234 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.840306 (+ 1072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50662: BlockingRecv error: recv got EOF from 127.0.0.1:50662 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260924 12:59:02.881830 1630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:02.878692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50664 (local address 127.11.49.125:41197)
0924 12:59:02.879015 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.879023 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.879830 (+ 807us) server_negotiation.cc:407] Connection header received
0924 12:59:02.880167 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.880174 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.880322 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.880456 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.881567 (+ 1111us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50664: BlockingRecv error: recv got EOF from 127.0.0.1:50664 (error 108)
Metrics: {"server-negotiator.queue_time_us":152}
W20260924 12:59:02.954123 1630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:02.950698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50674 (local address 127.11.49.125:41197)
0924 12:59:02.950924 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:02.950931 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:02.951640 (+ 709us) server_negotiation.cc:407] Connection header received
0924 12:59:02.951872 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:02.951879 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:02.952033 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:02.952190 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:02.953815 (+ 1625us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50674: BlockingRecv error: recv got EOF from 127.0.0.1:50674 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260924 12:59:03.088505 1630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:03.085984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50682 (local address 127.11.49.125:41197)
0924 12:59:03.086251 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:03.086258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:03.086825 (+ 567us) server_negotiation.cc:407] Connection header received
0924 12:59:03.087014 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:03.087019 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:03.087141 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:03.087253 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:03.088131 (+ 878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50682: BlockingRecv error: recv got EOF from 127.0.0.1:50682 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
W20260924 12:59:03.351308 1630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:03.349331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50688 (local address 127.11.49.125:41197)
0924 12:59:03.349630 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:03.349638 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:03.349782 (+ 144us) server_negotiation.cc:407] Connection header received
0924 12:59:03.350052 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:03.350056 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:03.350139 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:03.350253 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:03.351114 (+ 861us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50688: BlockingRecv error: recv got EOF from 127.0.0.1:50688 (error 108)
Metrics: {"server-negotiator.queue_time_us":134}
I20260924 12:59:03.457726 1657 catalog_manager.cc:1259] Loaded cluster ID: c88b3b210d8e4c8d8024ba034b98c164
I20260924 12:59:03.457894 1657 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753: loading cluster ID for follower catalog manager: success
I20260924 12:59:03.461031 1657 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753: acquiring CA information for follower catalog manager: success
I20260924 12:59:03.463511 1657 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8ccf9f87456a451fac7c69ae0d47d753: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 12:59:03.629923 1688 catalog_manager.cc:1259] Loaded cluster ID: c88b3b210d8e4c8d8024ba034b98c164
I20260924 12:59:03.630036 1688 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b: loading cluster ID for follower catalog manager: success
I20260924 12:59:03.633049 1688 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b: acquiring CA information for follower catalog manager: success
I20260924 12:59:03.634970 1688 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1743f08495944129bf0caaa2f938b57b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 12:59:03.876322 1757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:03.869482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50702 (local address 127.11.49.125:41197)
0924 12:59:03.869999 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:03.870004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:03.870027 (+ 23us) server_negotiation.cc:407] Connection header received
0924 12:59:03.870167 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:03.870171 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:03.870334 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:03.870506 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:03.871093 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:03.871897 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:03.873830 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:03.874248 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:03.874388 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:03.874996 (+ 608us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:03.875599 (+ 603us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:03.875733 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:03.875927 (+ 194us) server_negotiation.cc:299] Negotiation successful
0924 12:59:03.876002 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":279,"threads_started":1}
I20260924 12:59:03.892030 1763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:03.885084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57716 (local address 127.11.49.124:41751)
0924 12:59:03.886120 (+ 1036us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:03.886125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:03.886141 (+ 16us) server_negotiation.cc:407] Connection header received
0924 12:59:03.886235 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:03.886238 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:03.886406 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:03.886553 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:03.887057 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:03.887783 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:03.889411 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:03.889829 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:03.889943 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:03.890686 (+ 743us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:03.891311 (+ 625us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:03.891500 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:03.891660 (+ 160us) server_negotiation.cc:299] Negotiation successful
0924 12:59:03.891731 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":912,"thread_start_us":781,"threads_started":1}
I20260924 12:59:03.910851 1763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:03.899658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57728 (local address 127.11.49.124:41751)
0924 12:59:03.900467 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:03.900476 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:03.903819 (+ 3343us) server_negotiation.cc:407] Connection header received
0924 12:59:03.904072 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:03.904079 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:03.904189 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:03.904334 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:03.905227 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:03.906472 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:03.908562 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:03.909067 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:03.909228 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:03.909806 (+ 578us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:03.909962 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:03.910065 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:03.910392 (+ 327us) server_negotiation.cc:299] Negotiation successful
0924 12:59:03.910489 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623}
I20260924 12:59:03.911299 1757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:03.899573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50706 (local address 127.11.49.125:41197)
0924 12:59:03.899794 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:03.899803 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:03.904670 (+ 4867us) server_negotiation.cc:407] Connection header received
0924 12:59:03.904880 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:03.904885 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:03.904960 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:03.905056 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:03.905839 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:03.906704 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:03.909035 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:03.909668 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:03.909763 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:03.910468 (+ 705us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:03.910611 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:03.910673 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:03.910913 (+ 240us) server_negotiation.cc:299] Negotiation successful
0924 12:59:03.910997 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260924 12:59:03.912117 1769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:03.899573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48038 (local address 127.11.49.126:33777)
0924 12:59:03.904496 (+ 4923us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:03.904504 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:03.904527 (+ 23us) server_negotiation.cc:407] Connection header received
0924 12:59:03.904681 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:03.904689 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:03.904962 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:03.905937 (+ 975us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:03.906130 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:03.907276 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:03.909489 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:03.910088 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:03.910234 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:03.910838 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:03.911306 (+ 468us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:03.911440 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:03.911671 (+ 231us) server_negotiation.cc:299] Negotiation successful
0924 12:59:03.911774 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4764,"thread_start_us":4930,"threads_started":1}
I20260924 12:59:03.918833 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 1405
I20260924 12:59:03.920367 1467 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:59:04.037194 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 1405
I20260924 12:59:04.064147 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 1479
I20260924 12:59:04.065474 1541 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:59:04.177407 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 1479
I20260924 12:59:04.199143 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 1555
I20260924 12:59:04.200764 1617 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:59:04.309109 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 1555
2026-09-24T12:59:04Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5490 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 12:59:04 dist-test-slave-m9hg krb5kdc[1777](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 12:59:04 dist-test-slave-m9hg krb5kdc[1777](info): set up 2 sockets
Sep 24 12:59:04 dist-test-slave-m9hg krb5kdc[1777](info): commencing operation
krb5kdc: starting...
W20260924 12:59:05.473676 11461 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/test-user.keytab.
Sep 24 12:59:05 dist-test-slave-m9hg krb5kdc[1777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T12:59:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T12:59:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.49.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
Entry for principal kudu/127.11.49.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab.
I20260924 12:59:05.812698 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:45897
--webserver_interface=127.11.49.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:37759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:45897,127.11.49.125:41683,127.11.49.124:37907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 12:59:06.257829 1790 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 12:59:06.258368 1790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:59:06.258539 1790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:59:06.258690 1790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:59:06.267589 1790 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:59:06.267740 1790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:59:06.267850 1790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:59:06.267946 1790 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:59:06.268064 1790 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:59:06.282269 1790 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:37759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:45897,127.11.49.125:41683,127.11.49.124:37907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.126.keytab
--principal=kudu/127.11.49.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.126:45897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.49.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:59:06.284219 1790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:59:06.286044 1790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:59:06.301126 1795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:06.301612 1796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:06.301705 1798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:59:06.303251 1790 server_base.cc:1034] running on GCE node
I20260924 12:59:06.304481 1790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:59:06.306511 1790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:59:06.307840 1790 hybrid_clock.cc:648] HybridClock initialized: now 1790254746307756 us; error 59 us; skew 500 ppm
I20260924 12:59:06.308394 1790 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:59:06 dist-test-slave-m9hg krb5kdc[1777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:59:06.313159 1790 init.cc:377] Logged in from keytab as kudu/127.11.49.126@KRBTEST.COM (short username kudu)
I20260924 12:59:06.315412 1790 webserver.cc:460] Webserver started at http://127.11.49.126:44831/ using document root <none> and password file <none>
I20260924 12:59:06.316488 1790 fs_manager.cc:359] Metadata directory not provided
I20260924 12:59:06.316650 1790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:59:06.317090 1790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:59:06.321229 1790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/data/instance:
uuid: "1687b983bbe6410a896f876a4bd61e78"
format_stamp: "Formatted at 2026-09-24 12:59:06 on dist-test-slave-m9hg"
server_key: "fb35a65f0c1a17e218b60b8ca0e1aeb5"
server_key_iv: "0332893cc0d4dc4bc7c1125b0591f0ce"
server_key_version: "encryptionkey@0"
I20260924 12:59:06.322340 1790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/wal/instance:
uuid: "1687b983bbe6410a896f876a4bd61e78"
format_stamp: "Formatted at 2026-09-24 12:59:06 on dist-test-slave-m9hg"
server_key: "fb35a65f0c1a17e218b60b8ca0e1aeb5"
server_key_iv: "0332893cc0d4dc4bc7c1125b0591f0ce"
server_key_version: "encryptionkey@0"
I20260924 12:59:06.329583 1790 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260924 12:59:06.334475 1805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:59:06.336535 1790 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:59:06.336809 1790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/wal
uuid: "1687b983bbe6410a896f876a4bd61e78"
format_stamp: "Formatted at 2026-09-24 12:59:06 on dist-test-slave-m9hg"
server_key: "fb35a65f0c1a17e218b60b8ca0e1aeb5"
server_key_iv: "0332893cc0d4dc4bc7c1125b0591f0ce"
server_key_version: "encryptionkey@0"
I20260924 12:59:06.337105 1790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:59:06.360596 1790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:59:06.366606 1790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:59:06.366981 1790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:59:06.390477 1790 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.126:45897
I20260924 12:59:06.390506 1856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.126:45897 every 8 connection(s)
I20260924 12:59:06.392504 1790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/data/info.pb
I20260924 12:59:06.396971 1857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:59:06.399067 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 1790
I20260924 12:59:06.399286 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-0/wal/instance
I20260924 12:59:06.399850 11461 external_mini_cluster.cc:1428] Setting key d11f8c7526303dc8329c21a68acb849f
I20260924 12:59:06.407030 1857 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:59:06 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.49.125@KRBTEST.COM; defaulting to no policy
I20260924 12:59:06.432427 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.411903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:45897 (local address 127.0.0.1:50668)
0924 12:59:06.413150 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:06.413220 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:06.415585 (+ 2365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:06.416560 (+ 975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:06.416566 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:06.417312 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:06.417643 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:06.417660 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:06.419239 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:06.419246 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:06.420363 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:06.420376 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:06.421343 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:06.421350 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:06.421511 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:06.422218 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:06.422244 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:06.424649 (+ 2405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:06.427972 (+ 3323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:06.427985 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:06.427997 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:06.428486 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:06.428880 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:06.428886 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:06.428889 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:06.429043 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:06.429806 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:06.429819 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:06.430054 (+ 235us) client_negotiation.cc:769] Sending connection context
0924 12:59:06.430329 (+ 275us) client_negotiation.cc:240] Negotiation successful
0924 12:59:06.430990 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"mutex_wait_us":161,"thread_start_us":510,"threads_started":1}
I20260924 12:59:06.432461 1861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.411903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50668 (local address 127.11.49.126:45897)
0924 12:59:06.414326 (+ 2423us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:06.414339 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:06.414404 (+ 65us) server_negotiation.cc:407] Connection header received
0924 12:59:06.416008 (+ 1604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:06.416014 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:06.416333 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:06.416534 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:06.417868 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:06.419077 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:06.420496 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:06.421091 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:06.421307 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:06.424880 (+ 3573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:06.424889 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:06.424901 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:06.424930 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:06.427839 (+ 2909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:06.428621 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:06.428627 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:06.428629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:06.428775 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:06.429152 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:06.429157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:06.429164 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:06.429675 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:06.429889 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:06.430448 (+ 559us) server_negotiation.cc:299] Negotiation successful
0924 12:59:06.430875 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":2163,"spinlock_wait_cycles":32000,"thread_start_us":1876,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.125@KRBTEST.COM" created.
I20260924 12:59:06.436717 1857 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:59:06.438199 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.437623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33616)
0924 12:59:06.437886 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:06.438036 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260924 12:59:06.438512 1806 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
I20260924 12:59:06.440488 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.440018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33618)
0924 12:59:06.440179 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:06.440259 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260924 12:59:06.440677 1857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:41683: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab.
Entry for principal kudu/127.11.49.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab.
I20260924 12:59:06.468662 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.125:41683
--webserver_interface=127.11.49.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab
--principal=kudu/127.11.49.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:37759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:45897,127.11.49.125:41683,127.11.49.124:37907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:59:06.490126 1857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } attempt: 1
I20260924 12:59:06.491891 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.491073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33632)
0924 12:59:06.491438 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:06.491653 (+ 215us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260924 12:59:06.493400 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.492887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33634)
0924 12:59:06.493084 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:06.493199 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260924 12:59:06.493710 1857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:41683: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
I20260924 12:59:06.562134 1857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } attempt: 2
I20260924 12:59:06.563910 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.563077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33638)
0924 12:59:06.563541 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:06.563697 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260924 12:59:06.565424 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.564958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33646)
0924 12:59:06.565151 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:06.565263 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260924 12:59:06.565714 1857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:41683: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
I20260924 12:59:06.657024 1857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } attempt: 3
I20260924 12:59:06.658543 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.657859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33654)
0924 12:59:06.658193 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:06.658332 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260924 12:59:06.660061 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.659580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33666)
0924 12:59:06.659767 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:06.659865 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260924 12:59:06.660349 1857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:41683: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
I20260924 12:59:06.803702 1857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } attempt: 4
I20260924 12:59:06.805106 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.804554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33672)
0924 12:59:06.804873 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:06.804962 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260924 12:59:06.806524 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:06.806098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33682)
0924 12:59:06.806300 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:06.806396 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260924 12:59:06.806862 1857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.125:41683: Network error: Client connection negotiation failed: client connection to 127.11.49.125:41683: connect: Connection refused (error 111)
W20260924 12:59:06.851089 1864 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 12:59:06.851608 1864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:59:06.851743 1864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:59:06.851891 1864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 12:59:06.860474 1864 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:59:06.860616 1864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:59:06.860714 1864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:59:06.860800 1864 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:59:06.860893 1864 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:59:06.872610 1864 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:37759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:45897,127.11.49.125:41683,127.11.49.124:37907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.125.keytab
--principal=kudu/127.11.49.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.125:41683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.49.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:59:06.874434 1864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:59:06.876137 1864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:59:06.890563 1870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:06.891009 1872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:06.891377 1869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:59:06.891830 1864 server_base.cc:1034] running on GCE node
I20260924 12:59:06.892956 1864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:59:06.894894 1864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:59:06.896301 1864 hybrid_clock.cc:648] HybridClock initialized: now 1790254746896116 us; error 73 us; skew 500 ppm
I20260924 12:59:06.896759 1864 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:59:06 dist-test-slave-m9hg krb5kdc[1777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:59:06.906765 1864 init.cc:377] Logged in from keytab as kudu/127.11.49.125@KRBTEST.COM (short username kudu)
I20260924 12:59:06.908896 1864 webserver.cc:460] Webserver started at http://127.11.49.125:40699/ using document root <none> and password file <none>
I20260924 12:59:06.909778 1864 fs_manager.cc:359] Metadata directory not provided
I20260924 12:59:06.909880 1864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:59:06.910207 1864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:59:06.914038 1864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/data/instance:
uuid: "9dd0028897ec486f8fe140c62f1793e2"
format_stamp: "Formatted at 2026-09-24 12:59:06 on dist-test-slave-m9hg"
server_key: "f0c06e892ed1a0728d7689895e47a4f8"
server_key_iv: "edeea12161cb8cc2fca8a5b75b0ad6ab"
server_key_version: "encryptionkey@0"
I20260924 12:59:06.914981 1864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/wal/instance:
uuid: "9dd0028897ec486f8fe140c62f1793e2"
format_stamp: "Formatted at 2026-09-24 12:59:06 on dist-test-slave-m9hg"
server_key: "f0c06e892ed1a0728d7689895e47a4f8"
server_key_iv: "edeea12161cb8cc2fca8a5b75b0ad6ab"
server_key_version: "encryptionkey@0"
I20260924 12:59:06.921959 1864 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260924 12:59:06.926576 1879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:59:06.928746 1864 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260924 12:59:06.929052 1864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/wal
uuid: "9dd0028897ec486f8fe140c62f1793e2"
format_stamp: "Formatted at 2026-09-24 12:59:06 on dist-test-slave-m9hg"
server_key: "f0c06e892ed1a0728d7689895e47a4f8"
server_key_iv: "edeea12161cb8cc2fca8a5b75b0ad6ab"
server_key_version: "encryptionkey@0"
I20260924 12:59:06.929404 1864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:59:06.956202 1864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:59:06.962257 1864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:59:06.962643 1864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:59:06.986117 1864 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.125:41683
I20260924 12:59:06.986125 1930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.125:41683 every 8 connection(s)
I20260924 12:59:06.987977 1864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/data/info.pb
I20260924 12:59:06.988631 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 1864
I20260924 12:59:06.988890 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-1/wal/instance
I20260924 12:59:06.989454 11461 external_mini_cluster.cc:1428] Setting key daea44a304fb8a58a75ca3a3746d8ed2
I20260924 12:59:06.993316 1931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:59:07.002177 1931 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.49.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.49.124@KRBTEST.COM" created.
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:59:07.029176 1934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.005771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50684 (local address 127.11.49.126:45897)
0924 12:59:07.006415 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.006420 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.007853 (+ 1433us) server_negotiation.cc:407] Connection header received
0924 12:59:07.010529 (+ 2676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.010536 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.010666 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.010805 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.013127 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.013995 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.016112 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.017017 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.017205 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.021722 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.021728 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.021732 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.021797 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.025062 (+ 3265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.026189 (+ 1127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.026194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.026197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.026346 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.026860 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.026870 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.026873 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.027227 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.027399 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.028407 (+ 1008us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.028729 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":384,"threads_started":1}
I20260924 12:59:07.030467 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.006488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:45897 (local address 127.0.0.1:50684)
0924 12:59:07.007597 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.007665 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:07.010076 (+ 2411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:07.011156 (+ 1080us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:07.011168 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:07.011925 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:07.012823 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.012848 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.014207 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.014211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.015882 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.015906 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.017339 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.017348 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.017663 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.018522 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:07.018552 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:07.021353 (+ 2801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:07.025286 (+ 3933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.025299 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.025329 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.026018 (+ 689us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.026480 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.026486 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.026490 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.026729 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.027378 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:07.027388 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:07.027893 (+ 505us) client_negotiation.cc:769] Sending connection context
0924 12:59:07.028222 (+ 329us) client_negotiation.cc:240] Negotiation successful
0924 12:59:07.028997 (+ 775us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"thread_start_us":425,"threads_started":1}
I20260924 12:59:07.033095 1931 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.49.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab.
Entry for principal kudu/127.11.49.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab.
I20260924 12:59:07.052492 11461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvGPshr/build/asan/bin/kudu
/tmp/dist-test-taskvGPshr/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.124:37907
--webserver_interface=127.11.49.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab
--principal=kudu/127.11.49.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.49.84:37759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.49.126:45897,127.11.49.125:41683,127.11.49.124:37907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 12:59:07.054454 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.034002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33696)
0924 12:59:07.034318 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.034344 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:07.034534 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:07.036129 (+ 1595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:07.036138 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:07.036865 (+ 727us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:07.037147 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.037166 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.038868 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.038877 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.040485 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.040507 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.041933 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.041939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.042098 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.043016 (+ 918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:07.043036 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:07.046405 (+ 3369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:07.050870 (+ 4465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.050876 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.050880 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.051488 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.051965 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.051975 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.051979 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.052126 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.052956 (+ 830us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:07.052965 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:07.053212 (+ 247us) client_negotiation.cc:769] Sending connection context
0924 12:59:07.053420 (+ 208us) client_negotiation.cc:240] Negotiation successful
0924 12:59:07.053862 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260924 12:59:07.054649 1937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.034506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33696 (local address 127.11.49.125:41683)
0924 12:59:07.035413 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.035422 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.035485 (+ 63us) server_negotiation.cc:407] Connection header received
0924 12:59:07.035571 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.035580 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.035872 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.036042 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.037464 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.038671 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.040716 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.041727 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.041864 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.046755 (+ 4891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.046775 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.046795 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.046843 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.050532 (+ 3689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.051673 (+ 1141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.051684 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.051687 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.051838 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.052252 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.052262 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.052264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.052759 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.052998 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.053625 (+ 627us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.054071 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":136,"server-negotiator.queue_time_us":710,"thread_start_us":483,"threads_started":1}
I20260924 12:59:07.058091 1931 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:59:07.059667 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.058943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51030)
0924 12:59:07.059216 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.059403 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260924 12:59:07.060025 1882 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
I20260924 12:59:07.062287 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.061692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51046)
0924 12:59:07.061934 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.062072 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260924 12:59:07.062624 1931 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:37907: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
I20260924 12:59:07.106154 1857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } attempt: 5
I20260924 12:59:07.112042 1931 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } attempt: 1
I20260924 12:59:07.113755 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.112907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51052)
0924 12:59:07.113268 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.113468 (+ 200us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260924 12:59:07.115149 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.114719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51056)
0924 12:59:07.114906 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.115002 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
W20260924 12:59:07.115410 1931 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:37907: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
I20260924 12:59:07.123085 1937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.107418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33708 (local address 127.11.49.125:41683)
0924 12:59:07.107662 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.107669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.107697 (+ 28us) server_negotiation.cc:407] Connection header received
0924 12:59:07.107782 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.107793 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.107888 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.108006 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.109068 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.109856 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.111112 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.111602 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.111747 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.116560 (+ 4813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.116567 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.116572 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.116610 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.119724 (+ 3114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.120844 (+ 1120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.120856 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.120859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.121026 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.121547 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.121551 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.121553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.121910 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.122043 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.122595 (+ 552us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.122830 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260924 12:59:07.123189 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.107201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33708)
0924 12:59:07.107431 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.107458 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:07.107655 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:07.108040 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:07.108045 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:07.108675 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:07.108898 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.108908 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.110000 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.110007 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.110959 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.110972 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.111778 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.111783 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.112046 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.113025 (+ 979us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:07.113051 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:07.116259 (+ 3208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:07.119962 (+ 3703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.119969 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.119973 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.120667 (+ 694us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.121165 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.121170 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.121173 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.121369 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.122055 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:07.122062 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:07.122269 (+ 207us) client_negotiation.cc:769] Sending connection context
0924 12:59:07.122477 (+ 208us) client_negotiation.cc:240] Negotiation successful
0924 12:59:07.122821 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260924 12:59:07.124459 1857 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:59:07.126107 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.125496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51064)
0924 12:59:07.125750 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.125884 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260924 12:59:07.127344 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.126976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51074)
0924 12:59:07.127121 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.127239 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260924 12:59:07.127749 1857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:37907: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
I20260924 12:59:07.179097 1857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } attempt: 1
I20260924 12:59:07.180845 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.180104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51082)
0924 12:59:07.180454 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.180583 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260924 12:59:07.182089 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.181704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51096)
0924 12:59:07.181866 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.181958 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260924 12:59:07.182392 1857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:37907: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
I20260924 12:59:07.183679 1931 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } attempt: 2
I20260924 12:59:07.185129 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.184549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51102)
0924 12:59:07.184803 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.184912 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260924 12:59:07.186261 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.185879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51118)
0924 12:59:07.186043 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.186133 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260924 12:59:07.186512 1931 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:37907: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
I20260924 12:59:07.250738 1857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } attempt: 2
I20260924 12:59:07.252439 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.251704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51134)
0924 12:59:07.251991 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.252134 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260924 12:59:07.253494 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.253125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51142)
0924 12:59:07.253280 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.253379 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260924 12:59:07.253710 1857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:37907: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
I20260924 12:59:07.277823 1931 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } attempt: 3
I20260924 12:59:07.279567 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.278747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51148)
0924 12:59:07.279110 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.279306 (+ 196us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
I20260924 12:59:07.281401 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.280694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51164)
0924 12:59:07.281060 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.281205 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212}
W20260924 12:59:07.281795 1931 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:37907: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
I20260924 12:59:07.360009 1857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } attempt: 3
I20260924 12:59:07.361769 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.361084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51170)
0924 12:59:07.361376 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.361508 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260924 12:59:07.363041 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.362626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51184)
0924 12:59:07.362836 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.362926 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260924 12:59:07.363325 1857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:37907: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
W20260924 12:59:07.418761 1939 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 12:59:07.419137 1939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 12:59:07.419257 1939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 12:59:07.419417 1939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260924 12:59:07.425103 1931 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } attempt: 4
I20260924 12:59:07.426759 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.426095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51196)
0924 12:59:07.426388 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.426532 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260924 12:59:07.428047 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.427653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51212)
0924 12:59:07.427818 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.427914 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260924 12:59:07.428344 1931 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.49.124:37907: Network error: Client connection negotiation failed: client connection to 127.11.49.124:37907: connect: Connection refused (error 111)
W20260924 12:59:07.428987 1939 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 12:59:07.429072 1939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 12:59:07.429224 1939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 12:59:07.429311 1939 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 12:59:07.429406 1939 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 12:59:07.441004 1939 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.49.84:37759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.49.126:45897,127.11.49.125:41683,127.11.49.124:37907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/krb5kdc/kudu_127.11.49.124.keytab
--principal=kudu/127.11.49.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.49.124:37907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.49.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 24 Sep 2026 11:23:59 UTC on ccycloud.quasar-uwcnyx.root.comops.site
build id 4669763
ASAN enabled
I20260924 12:59:07.442461 1939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 12:59:07.443903 1939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 12:59:07.457795 1944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:07.457866 1945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 12:59:07.457928 1947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 12:59:07.460450 1939 server_base.cc:1034] running on GCE node
I20260924 12:59:07.461378 1939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 12:59:07.462909 1939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 12:59:07.464210 1939 hybrid_clock.cc:648] HybridClock initialized: now 1790254747464104 us; error 57 us; skew 500 ppm
I20260924 12:59:07.464893 1939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254747, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 12:59:07.468802 1939 init.cc:377] Logged in from keytab as kudu/127.11.49.124@KRBTEST.COM (short username kudu)
I20260924 12:59:07.470777 1939 webserver.cc:460] Webserver started at http://127.11.49.124:36505/ using document root <none> and password file <none>
I20260924 12:59:07.471778 1939 fs_manager.cc:359] Metadata directory not provided
I20260924 12:59:07.471920 1939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 12:59:07.472401 1939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 12:59:07.476362 1939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/data/instance:
uuid: "d4516a703b5746d995e167fc21466eda"
format_stamp: "Formatted at 2026-09-24 12:59:07 on dist-test-slave-m9hg"
server_key: "2b574fa080a5261cffa211966f066952"
server_key_iv: "df22a0fbfbe1f935b3d65504cd53b075"
server_key_version: "encryptionkey@0"
I20260924 12:59:07.477430 1939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/wal/instance:
uuid: "d4516a703b5746d995e167fc21466eda"
format_stamp: "Formatted at 2026-09-24 12:59:07 on dist-test-slave-m9hg"
server_key: "2b574fa080a5261cffa211966f066952"
server_key_iv: "df22a0fbfbe1f935b3d65504cd53b075"
server_key_version: "encryptionkey@0"
I20260924 12:59:07.484457 1939 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260924 12:59:07.489475 1954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 12:59:07.491467 1939 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260924 12:59:07.491765 1939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/data,/tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/wal
uuid: "d4516a703b5746d995e167fc21466eda"
format_stamp: "Formatted at 2026-09-24 12:59:07 on dist-test-slave-m9hg"
server_key: "2b574fa080a5261cffa211966f066952"
server_key_iv: "df22a0fbfbe1f935b3d65504cd53b075"
server_key_version: "encryptionkey@0"
I20260924 12:59:07.492110 1939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 12:59:07.510526 1939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 12:59:07.516587 1939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 12:59:07.516957 1939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 12:59:07.540573 1857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } attempt: 4
I20260924 12:59:07.541203 1939 rpc_server.cc:307] RPC server started. Bound to: 127.11.49.124:37907
I20260924 12:59:07.541211 2005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.49.124:37907 every 8 connection(s)
I20260924 12:59:07.543542 1939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/data/info.pb
I20260924 12:59:07.549378 2007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 12:59:07.549714 11461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvGPshr/build/asan/bin/kudu as pid 1939
I20260924 12:59:07.549928 11461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvGPshr/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790254326970360-11461-0/minicluster-data/master-2/wal/instance
I20260924 12:59:07.550609 11461 external_mini_cluster.cc:1428] Setting key 017d658aaa8f0c36d5883bbc452c4378
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.126@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
I20260924 12:59:07.562487 2007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
I20260924 12:59:07.569059 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.541281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51214)
0924 12:59:07.541520 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.541543 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:07.541696 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:07.547407 (+ 5711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:07.547412 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:07.547971 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:07.548154 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.548164 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.550137 (+ 1973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.550141 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.551128 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.551141 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.553007 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.553015 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.553280 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.554228 (+ 948us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:07.554255 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:07.557796 (+ 3541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:07.564047 (+ 6251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.564055 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.564062 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.564760 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.565461 (+ 701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.565465 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.565469 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.565639 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.567408 (+ 1769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:07.567417 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:07.567760 (+ 343us) client_negotiation.cc:769] Sending connection context
0924 12:59:07.567984 (+ 224us) client_negotiation.cc:240] Negotiation successful
0924 12:59:07.568535 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260924 12:59:07.570765 2006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.542942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51214 (local address 127.11.49.124:37907)
0924 12:59:07.543987 (+ 1045us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.544029 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.544080 (+ 51us) server_negotiation.cc:407] Connection header received
0924 12:59:07.546442 (+ 2362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.546471 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.546982 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.547431 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.548372 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.549902 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.551352 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.552686 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.553817 (+ 1131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.558234 (+ 4417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.558252 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.558285 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.558353 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.563781 (+ 5428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.564953 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.564964 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.564975 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.565284 (+ 309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.565778 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.565783 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.565787 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.566560 (+ 773us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.566821 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.568420 (+ 1599us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.569001 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":728,"thread_start_us":466,"threads_started":1}
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254747, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:59:07.578928 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.551898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51218 (local address 127.11.49.124:37907)
0924 12:59:07.556671 (+ 4773us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.556679 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.557412 (+ 733us) server_negotiation.cc:407] Connection header received
0924 12:59:07.557797 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.557804 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.557922 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.558068 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.559819 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.561076 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.562368 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.562858 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.563031 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.569822 (+ 6791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.569830 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.569835 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.569889 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.575118 (+ 5229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.576437 (+ 1319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.576441 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.576444 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.576608 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.577099 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.577105 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.577109 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.577508 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.577821 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.578238 (+ 417us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.578500 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4592,"thread_start_us":5363,"threads_started":1}
I20260924 12:59:07.581228 1857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78: Bootstrap starting.
I20260924 12:59:07.589352 2012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.566994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.126:45897 (local address 127.0.0.1:50698)
0924 12:59:07.568087 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.568176 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:07.568438 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:07.569157 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:07.569166 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:07.570583 (+ 1417us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:07.571032 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.571051 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.572581 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.572589 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.574210 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.574238 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.575556 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.575563 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.575805 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.576812 (+ 1007us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:07.576834 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:07.579832 (+ 2998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:07.585480 (+ 5648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.585502 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.585512 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.586182 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.586817 (+ 635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.586824 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.586829 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.587017 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.587910 (+ 893us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:07.587921 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:07.588131 (+ 210us) client_negotiation.cc:769] Sending connection context
0924 12:59:07.588408 (+ 277us) client_negotiation.cc:240] Negotiation successful
0924 12:59:07.588848 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":450,"threads_started":1}
I20260924 12:59:07.590619 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.567036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50698 (local address 127.11.49.126:45897)
0924 12:59:07.567796 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.567802 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.568576 (+ 774us) server_negotiation.cc:407] Connection header received
0924 12:59:07.568641 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.568648 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.568751 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.568874 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.571367 (+ 2493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.572235 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.574463 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.575321 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.575502 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.580094 (+ 4592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.580099 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.580103 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.580143 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.585271 (+ 5128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.586357 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.586367 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.586373 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.586597 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.587174 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.587181 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.587186 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.587753 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.589682 (+ 1929us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.589844 (+ 162us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.590137 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":572,"thread_start_us":3110,"threads_started":1}
I20260924 12:59:07.592563 1857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78: Neither blocks nor log segments found. Creating new log.
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.126@KRBTEST.COM
I20260924 12:59:07.593868 2007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:59:07.594398 1857 log.cc:824] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78: Log is configured to *not* fsync() on all Append() calls
I20260924 12:59:07.601083 1857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78: No bootstrap required, opened a new log
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254747, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
I20260924 12:59:07.605075 2013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.581458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50712 (local address 127.11.49.126:45897)
0924 12:59:07.582265 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.582275 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.582305 (+ 30us) server_negotiation.cc:407] Connection header received
0924 12:59:07.582497 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.582504 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.582602 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.582744 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.584095 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.585066 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.586709 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.587460 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.587580 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.595307 (+ 7727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.595317 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.595322 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.595375 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.599930 (+ 4555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.601019 (+ 1089us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.601025 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.601028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.601317 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.601989 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.601994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.602000 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.602453 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.602748 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.604151 (+ 1403us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.604495 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":643,"thread_start_us":369,"threads_started":1}
I20260924 12:59:07.611246 2012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.594935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.125:41683 (local address 127.0.0.1:33716)
0924 12:59:07.595481 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.595507 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:07.595635 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:07.596391 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:07.596398 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:07.596939 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:07.597169 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.597182 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.598785 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.598789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.599679 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.599701 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.600909 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.600918 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.601100 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.601756 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:07.601775 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:07.603773 (+ 1998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:07.608003 (+ 4230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.608010 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.608014 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.608652 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.609170 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.609175 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.609179 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.609353 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.610197 (+ 844us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:07.610202 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:07.610391 (+ 189us) client_negotiation.cc:769] Sending connection context
0924 12:59:07.610562 (+ 171us) client_negotiation.cc:240] Negotiation successful
0924 12:59:07.610866 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344}
I20260924 12:59:07.611510 1937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.595478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33716 (local address 127.11.49.125:41683)
0924 12:59:07.595816 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.595827 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.595859 (+ 32us) server_negotiation.cc:407] Connection header received
0924 12:59:07.595971 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.595980 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.596121 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.596346 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.597400 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.598562 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.599843 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.600516 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.600660 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.604180 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.604185 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.604188 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.604227 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.607374 (+ 3147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.608818 (+ 1444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.608824 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.608828 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.609018 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.609488 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.609494 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.609497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.610023 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.610220 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.610705 (+ 485us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.611000 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260924 12:59:07.613023 2007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } has no permanent_uuid. Determining permanent_uuid...
I20260924 12:59:07.613677 1857 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } }
I20260924 12:59:07.614188 1857 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1687b983bbe6410a896f876a4bd61e78, State: Initialized, Role: FOLLOWER
I20260924 12:59:07.614820 1857 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } }
I20260924 12:59:07.616395 2016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } } }
I20260924 12:59:07.617107 2016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:07.617969 1857 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [sys.catalog]: configured and running, proceeding with master startup.
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.49.125@KRBTEST.COM
W20260924 12:59:07.620896 1811 tablet.cc:2369] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254747, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.124@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
I20260924 12:59:07.631151 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.607897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33728 (local address 127.11.49.125:41683)
0924 12:59:07.608693 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.608699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.608723 (+ 24us) server_negotiation.cc:407] Connection header received
0924 12:59:07.608784 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.608787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.608857 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.609032 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.610981 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.612229 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.614210 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.614859 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.614992 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.621982 (+ 6990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.621995 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.622002 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.622073 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.626960 (+ 4887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.628149 (+ 1189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.628156 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.628160 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.628447 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.629163 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.629169 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.629173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.629565 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.629893 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.630297 (+ 404us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.630641 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":444,"threads_started":1}
I20260924 12:59:07.631366 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.614234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51234 (local address 127.11.49.124:37907)
0924 12:59:07.614466 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.614472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.614691 (+ 219us) server_negotiation.cc:407] Connection header received
0924 12:59:07.614859 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.614865 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.614970 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.615081 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.616228 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.617332 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.618518 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.618969 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.619123 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.623701 (+ 4578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.623713 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.623716 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.623748 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.626747 (+ 2999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.627981 (+ 1234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.627988 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.627993 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.628216 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.628894 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.628900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.628904 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.629466 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.629644 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.630346 (+ 702us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.630723 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":84}
I20260924 12:59:07.632910 2012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.613971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51234)
0924 12:59:07.614570 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.614589 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:07.614721 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:07.615273 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:07.615277 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:07.615835 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:07.616059 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.616071 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.617457 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.617462 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.618362 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.618373 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.619136 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.619141 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.619417 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.620339 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:07.620373 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:07.623453 (+ 3080us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:07.626937 (+ 3484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.626943 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.626948 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.627786 (+ 838us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.628433 (+ 647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.628440 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.628445 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.628706 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.629751 (+ 1045us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:07.629758 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:07.629999 (+ 241us) client_negotiation.cc:769] Sending connection context
0924 12:59:07.631986 (+ 1987us) client_negotiation.cc:240] Negotiation successful
0924 12:59:07.632465 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":18}
I20260924 12:59:07.638983 11461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 12:59:07.640331 2007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda: Bootstrap starting.
I20260924 12:59:07.643528 1832 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "1687b983bbe6410a896f876a4bd61e78"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50712
I20260924 12:59:07.644333 1832 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260924 12:59:07.644604 1832 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:59:07.646133 2007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda: Neither blocks nor log segments found. Creating new log.
I20260924 12:59:07.647933 2007 log.cc:824] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda: Log is configured to *not* fsync() on all Append() calls
I20260924 12:59:07.649933 1832 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } }
I20260924 12:59:07.655215 1832 leader_election.cc:288] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [CANDIDATE]: Term 1 election: Requested vote from peers 9dd0028897ec486f8fe140c62f1793e2 (127.11.49.125:41683), d4516a703b5746d995e167fc21466eda (127.11.49.124:37907)
W20260924 12:59:07.667070 2027 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260924 12:59:07.667030 2007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda: No bootstrap required, opened a new log
W20260924 12:59:07.667431 2027 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 12:59:07.647576 1790 master_runner.cc:186] Error getting master registration for 127.11.49.125:41683: OK, instance_id { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" instance_seqno: 1790254746979461 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 12:59:07.674039 1790 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260924 12:59:07.705013 2007 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } }
I20260924 12:59:07.705765 2007 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4516a703b5746d995e167fc21466eda, State: Initialized, Role: FOLLOWER
I20260924 12:59:07.706568 2007 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } }
I20260924 12:59:07.717576 2013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.681424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50726 (local address 127.11.49.126:45897)
0924 12:59:07.681761 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.681772 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.683296 (+ 1524us) server_negotiation.cc:407] Connection header received
0924 12:59:07.683849 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.683859 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.684008 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.684125 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.689392 (+ 5267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.691058 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.694834 (+ 3776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.695649 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.695799 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.705749 (+ 9950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.705762 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.705767 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.705835 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.710891 (+ 5056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.712797 (+ 1906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.712810 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.712813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.713210 (+ 397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.714258 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.714267 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.714272 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.715205 (+ 933us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.715769 (+ 564us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.716723 (+ 954us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.717088 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260924 12:59:07.720556 2037 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } } }
I20260924 12:59:07.721179 2037 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:07.721396 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.681496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51250 (local address 127.11.49.124:37907)
0924 12:59:07.681747 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.681754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.692048 (+ 10294us) server_negotiation.cc:407] Connection header received
0924 12:59:07.692628 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.692636 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.692734 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.692826 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.697655 (+ 4829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.698874 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.702844 (+ 3970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.703517 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.703629 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.710621 (+ 6992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.710631 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.710636 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.710696 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.714763 (+ 4067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.716797 (+ 2034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.716805 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.716809 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.716995 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.718385 (+ 1390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.718392 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.718395 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.718842 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.719097 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.720352 (+ 1255us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.720677 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260924 12:59:07.723803 2007 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:59:07.724743 1981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1687b983bbe6410a896f876a4bd61e78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d4516a703b5746d995e167fc21466eda"
I20260924 12:59:07.725461 1981 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:59:07.725561 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.683277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33740 (local address 127.11.49.125:41683)
0924 12:59:07.683532 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.683540 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.700325 (+ 16785us) server_negotiation.cc:407] Connection header received
0924 12:59:07.700968 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.700978 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.701102 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.701197 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.707482 (+ 6285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.708999 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.711550 (+ 2551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.712373 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.712509 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.717076 (+ 4567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.717082 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.717087 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.717137 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.721575 (+ 4438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.722599 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.722606 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.722609 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.722792 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.723333 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.723338 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.723341 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.723771 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.724053 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.724830 (+ 777us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.725145 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260924 12:59:07.727849 1931 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } attempt: 5
I20260924 12:59:07.735572 1981 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1687b983bbe6410a896f876a4bd61e78 in term 1.
I20260924 12:59:07.736801 1808 leader_election.cc:302] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1687b983bbe6410a896f876a4bd61e78, d4516a703b5746d995e167fc21466eda; no voters:
I20260924 12:59:07.737409 2016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [term 1 FOLLOWER]: Leader election won for term 1
Sep 24 12:59:07 dist-test-slave-m9hg krb5kdc[1777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790254746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.49.125@KRBTEST.COM for kudu/127.11.49.124@KRBTEST.COM
I20260924 12:59:07.752985 2016 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [term 1 LEADER]: Becoming Leader. State: Replica: 1687b983bbe6410a896f876a4bd61e78, State: Running, Role: LEADER
I20260924 12:59:07.754580 2016 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } }
I20260924 12:59:07.758831 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.729107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.49.124:37907 (local address 127.0.0.1:51258)
0924 12:59:07.729370 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0924 12:59:07.729398 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 12:59:07.729558 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 12:59:07.730122 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 12:59:07.730131 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 12:59:07.730987 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0924 12:59:07.731336 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.731354 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.733529 (+ 2175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.733540 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.735700 (+ 2160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 12:59:07.735743 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.737721 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.737732 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 12:59:07.738075 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.739162 (+ 1087us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 12:59:07.739200 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0924 12:59:07.745996 (+ 6796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 12:59:07.754046 (+ 8050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.754062 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.754070 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.754956 (+ 886us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.755669 (+ 713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 12:59:07.755677 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 12:59:07.755684 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0924 12:59:07.755950 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 12:59:07.757110 (+ 1160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 12:59:07.757118 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 12:59:07.757381 (+ 263us) client_negotiation.cc:769] Sending connection context
0924 12:59:07.757601 (+ 220us) client_negotiation.cc:240] Negotiation successful
0924 12:59:07.758139 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260924 12:59:07.760365 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:07.729066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51258 (local address 127.11.49.124:37907)
0924 12:59:07.729301 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:07.729308 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:07.729524 (+ 216us) server_negotiation.cc:407] Connection header received
0924 12:59:07.729728 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:07.729737 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:07.729874 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:07.731574 (+ 1700us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:07.731785 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.733282 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.736049 (+ 2767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:07.737184 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:07.737361 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:07.746787 (+ 9426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 12:59:07.746804 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 12:59:07.746813 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 12:59:07.746963 (+ 150us) server_negotiation.cc:922] calling sasl_server_start()
0924 12:59:07.753615 (+ 6652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.755185 (+ 1570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.755194 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.755201 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.755455 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 12:59:07.756125 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 12:59:07.756133 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 12:59:07.756140 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0924 12:59:07.756783 (+ 643us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 12:59:07.757004 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:07.759338 (+ 2334us) server_negotiation.cc:299] Negotiation successful
0924 12:59:07.759784 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260924 12:59:07.767280 1931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2: Bootstrap starting.
W20260924 12:59:07.769670 1960 tablet.cc:2369] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 12:59:07.772161 2050 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 12:59:07.772390 2050 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 12:59:07.773695 1931 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2: Neither blocks nor log segments found. Creating new log.
I20260924 12:59:07.775352 1931 log.cc:824] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2: Log is configured to *not* fsync() on all Append() calls
I20260924 12:59:07.780189 1931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2: No bootstrap required, opened a new log
I20260924 12:59:07.793459 2040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1687b983bbe6410a896f876a4bd61e78. Latest consensus state: current_term: 1 leader_uuid: "1687b983bbe6410a896f876a4bd61e78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } } }
I20260924 12:59:07.794117 2040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [sys.catalog]: This master's current role is: LEADER
I20260924 12:59:07.812119 2053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 12:59:07.800166 1939 master_runner.cc:186] Error getting master registration for 127.11.49.125:41683: OK, instance_id { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" instance_seqno: 1790254746979461 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 12:59:07.816123 1939 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260924 12:59:07.828748 2053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 12:59:07.831516 1931 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } }
I20260924 12:59:07.832142 1931 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd0028897ec486f8fe140c62f1793e2, State: Initialized, Role: FOLLOWER
I20260924 12:59:07.832854 1931 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } }
I20260924 12:59:07.841066 2054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } } }
I20260924 12:59:07.843544 2054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:07.846141 1981 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [term 1 FOLLOWER]: Refusing update from remote peer 1687b983bbe6410a896f876a4bd61e78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:59:07.847380 2016 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:59:07.848646 1906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1687b983bbe6410a896f876a4bd61e78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9dd0028897ec486f8fe140c62f1793e2"
I20260924 12:59:07.849193 1905 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [term 0 FOLLOWER]: Advancing to term 1
I20260924 12:59:07.853479 1905 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [term 1 FOLLOWER]: Refusing update from remote peer 1687b983bbe6410a896f876a4bd61e78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 12:59:07.857399 1906 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1687b983bbe6410a896f876a4bd61e78 in term 1.
I20260924 12:59:07.860774 1931 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 12:59:07.860814 2016 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 12:59:07.884212 2054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1687b983bbe6410a896f876a4bd61e78. Latest consensus state: current_term: 1 leader_uuid: "1687b983bbe6410a896f876a4bd61e78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } } }
I20260924 12:59:07.884965 2054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:07.892657 2054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1687b983bbe6410a896f876a4bd61e78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } } }
I20260924 12:59:07.893051 2054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:07.904935 2040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1687b983bbe6410a896f876a4bd61e78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } } }
I20260924 12:59:07.905414 2040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [sys.catalog]: This master's current role is: LEADER
I20260924 12:59:07.909612 2058 mvcc.cc:205] Tried to move back new op lower bound from 7332883447162286080 to 7332883446817628160. Current Snapshot: MvccSnapshot[applied={T|T < 7332883447162286080}]
I20260924 12:59:07.911286 2053 catalog_manager.cc:1347] Generated new cluster ID: 41e6a397f3054d4dbf55a454fc84365c
I20260924 12:59:07.911427 2053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 12:59:07.925071 2037 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1687b983bbe6410a896f876a4bd61e78. Latest consensus state: current_term: 1 leader_uuid: "1687b983bbe6410a896f876a4bd61e78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } } }
I20260924 12:59:07.925494 2037 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:07.929291 2064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1687b983bbe6410a896f876a4bd61e78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } } }
I20260924 12:59:07.940686 2037 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1687b983bbe6410a896f876a4bd61e78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1687b983bbe6410a896f876a4bd61e78" member_type: VOTER last_known_addr { host: "127.11.49.126" port: 45897 } } peers { permanent_uuid: "9dd0028897ec486f8fe140c62f1793e2" member_type: VOTER last_known_addr { host: "127.11.49.125" port: 41683 } } peers { permanent_uuid: "d4516a703b5746d995e167fc21466eda" member_type: VOTER last_known_addr { host: "127.11.49.124" port: 37907 } } }
I20260924 12:59:07.941053 2037 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda [sys.catalog]: This master's current role is: FOLLOWER
I20260924 12:59:07.941574 2064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78 [sys.catalog]: This master's current role is: LEADER
I20260924 12:59:07.942456 2056 mvcc.cc:205] Tried to move back new op lower bound from 7332883447162286080 to 7332883446817628160. Current Snapshot: MvccSnapshot[applied={T|T < 7332883447162286080 or (T in {7332883447162286080})}]
I20260924 12:59:08.004551 2053 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 12:59:08.007966 2053 catalog_manager.cc:1504] Loading token signing keys...
I20260924 12:59:08.042716 2053 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1687b983bbe6410a896f876a4bd61e78: Generated new TSK 0
I20260924 12:59:08.044395 2053 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 12:59:08.081527 2074 catalog_manager.cc:1259] Loaded cluster ID: 41e6a397f3054d4dbf55a454fc84365c
I20260924 12:59:08.081840 2074 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2: loading cluster ID for follower catalog manager: success
I20260924 12:59:08.087447 2074 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2: acquiring CA information for follower catalog manager: success
I20260924 12:59:08.091527 2074 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9dd0028897ec486f8fe140c62f1793e2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260924 12:59:08.196527 11461 mini_kdc.cc:348] Time spent kdestroy: real 0.128s user 0.000s sys 0.033s
W20260924 12:59:08.224023 2013 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:08.211637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50732 (local address 127.11.49.126:45897)
0924 12:59:08.211907 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.211917 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.221282 (+ 9365us) server_negotiation.cc:407] Connection header received
0924 12:59:08.221716 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.221728 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.221896 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.222013 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:08.223636 (+ 1623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50732: BlockingRecv error: recv got EOF from 127.0.0.1:50732 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260924 12:59:08.226876 2010 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:08.212183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51270 (local address 127.11.49.124:37907)
0924 12:59:08.212425 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.212431 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.224648 (+ 12217us) server_negotiation.cc:407] Connection header received
0924 12:59:08.224873 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.224879 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.225035 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.225151 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:08.226570 (+ 1419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51270: BlockingRecv error: recv got EOF from 127.0.0.1:51270 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
W20260924 12:59:08.226902 2015 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:08.224667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33756 (local address 127.11.49.125:41683)
0924 12:59:08.224897 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.224903 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.225141 (+ 238us) server_negotiation.cc:407] Connection header received
0924 12:59:08.225395 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.225403 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.225510 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.225585 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:08.226577 (+ 992us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33756: BlockingRecv error: recv got EOF from 127.0.0.1:33756 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260924 12:59:08.254503 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.244018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33766 (local address 127.11.49.125:41683)
0924 12:59:08.244367 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.244376 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.244940 (+ 564us) server_negotiation.cc:407] Connection header received
0924 12:59:08.245422 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.245432 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.245788 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.245976 (+ 188us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.246983 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.248396 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.250782 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.251514 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.251629 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.252536 (+ 907us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.253496 (+ 960us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.253648 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.253927 (+ 279us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.254049 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
W20260924 12:59:08.305191 2010 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:08.302203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51286 (local address 127.11.49.124:37907)
0924 12:59:08.302416 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.302423 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.302687 (+ 264us) server_negotiation.cc:407] Connection header received
0924 12:59:08.303139 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.303147 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.303358 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.303460 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:08.304890 (+ 1430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51286: BlockingRecv error: recv got EOF from 127.0.0.1:51286 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260924 12:59:08.382980 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.362086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33782 (local address 127.11.49.125:41683)
0924 12:59:08.362327 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.362335 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.377262 (+ 14927us) server_negotiation.cc:407] Connection header received
0924 12:59:08.377492 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.377497 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.377594 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.377832 (+ 238us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.378421 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.379279 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.380940 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.381476 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.381653 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.382130 (+ 477us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.382265 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.382376 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.382545 (+ 169us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.382641 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
W20260924 12:59:08.402488 2010 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:08.394931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51302 (local address 127.11.49.124:37907)
0924 12:59:08.395185 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.395195 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.400970 (+ 5775us) server_negotiation.cc:407] Connection header received
0924 12:59:08.401197 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.401201 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.401295 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.401408 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:08.402283 (+ 875us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51302: BlockingRecv error: recv got EOF from 127.0.0.1:51302 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260924 12:59:08.418434 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.408716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33796 (local address 127.11.49.125:41683)
0924 12:59:08.408927 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.408932 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.412998 (+ 4066us) server_negotiation.cc:407] Connection header received
0924 12:59:08.413249 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.413257 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.413341 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.413462 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.413914 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.414809 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.416343 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.416837 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.417012 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.417450 (+ 438us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.417583 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.417692 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.418002 (+ 310us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.418091 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260924 12:59:08.432574 2010 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:08.430106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51308 (local address 127.11.49.124:37907)
0924 12:59:08.430385 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.430392 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.430691 (+ 299us) server_negotiation.cc:407] Connection header received
0924 12:59:08.430903 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.430910 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.431047 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.431234 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:08.432229 (+ 995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51308: BlockingRecv error: recv got EOF from 127.0.0.1:51308 (error 108)
Metrics: {"server-negotiator.queue_time_us":114}
I20260924 12:59:08.446370 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.440137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33806 (local address 127.11.49.125:41683)
0924 12:59:08.440449 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.440457 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.440629 (+ 172us) server_negotiation.cc:407] Connection header received
0924 12:59:08.440807 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.440813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.440932 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.441111 (+ 179us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.441786 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.442729 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.444088 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.444627 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.444776 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.445418 (+ 642us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.445592 (+ 174us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.445707 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.445867 (+ 160us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.445969 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
W20260924 12:59:08.460026 2010 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:08.455669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51322 (local address 127.11.49.124:37907)
0924 12:59:08.456085 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.456093 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.458258 (+ 2165us) server_negotiation.cc:407] Connection header received
0924 12:59:08.458491 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.458498 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.458642 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.458802 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:08.459710 (+ 908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51322: BlockingRecv error: recv got EOF from 127.0.0.1:51322 (error 108)
Metrics: {"server-negotiator.queue_time_us":229}
I20260924 12:59:08.479616 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.472031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33810 (local address 127.11.49.125:41683)
0924 12:59:08.472320 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.472328 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.472494 (+ 166us) server_negotiation.cc:407] Connection header received
0924 12:59:08.472727 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.472735 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.472869 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.473093 (+ 224us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.473791 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.475144 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.476843 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.477670 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.477874 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.478488 (+ 614us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.478669 (+ 181us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.478786 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.479067 (+ 281us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.479192 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
W20260924 12:59:08.489599 2010 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:08.486788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51326 (local address 127.11.49.124:37907)
0924 12:59:08.487039 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.487044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.487503 (+ 459us) server_negotiation.cc:407] Connection header received
0924 12:59:08.487766 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.487771 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.487954 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.488060 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:08.489321 (+ 1261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51326: BlockingRecv error: recv got EOF from 127.0.0.1:51326 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
I20260924 12:59:08.517429 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.510326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33818 (local address 127.11.49.125:41683)
0924 12:59:08.510587 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.510593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.511109 (+ 516us) server_negotiation.cc:407] Connection header received
0924 12:59:08.511399 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.511404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.511484 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.511586 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.512162 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.513113 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.515259 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.515727 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.515900 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.516525 (+ 625us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.516654 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.516734 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.516982 (+ 248us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.517075 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
W20260924 12:59:08.527452 2010 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:08.525329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51342 (local address 127.11.49.124:37907)
0924 12:59:08.525579 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.525586 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.525758 (+ 172us) server_negotiation.cc:407] Connection header received
0924 12:59:08.525968 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.525975 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.526106 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.526285 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:08.527134 (+ 849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51342: BlockingRecv error: recv got EOF from 127.0.0.1:51342 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260924 12:59:08.570852 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.563922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33822 (local address 127.11.49.125:41683)
0924 12:59:08.564183 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.564193 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.564589 (+ 396us) server_negotiation.cc:407] Connection header received
0924 12:59:08.564759 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.564765 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.564885 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.565050 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.565479 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.566787 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.568554 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.569251 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.569439 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.569895 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.570070 (+ 175us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.570182 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.570334 (+ 152us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.570457 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
W20260924 12:59:08.582453 2010 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:08.579456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51346 (local address 127.11.49.124:37907)
0924 12:59:08.579796 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.579803 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.580181 (+ 378us) server_negotiation.cc:407] Connection header received
0924 12:59:08.580540 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.580545 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.580638 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.580752 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:08.582036 (+ 1284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51346: BlockingRecv error: recv got EOF from 127.0.0.1:51346 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
I20260924 12:59:08.657447 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.651325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33826 (local address 127.11.49.125:41683)
0924 12:59:08.651684 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.651693 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.651971 (+ 278us) server_negotiation.cc:407] Connection header received
0924 12:59:08.652194 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.652206 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.652343 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.652459 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.652852 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.653786 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.655402 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.655955 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.656089 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.656575 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.656723 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.656847 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.656962 (+ 115us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.657048 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260924 12:59:08.675872 2010 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 12:59:08.670208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51350 (local address 127.11.49.124:37907)
0924 12:59:08.670388 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.670394 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.674319 (+ 3925us) server_negotiation.cc:407] Connection header received
0924 12:59:08.674540 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.674551 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.674643 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.674757 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0924 12:59:08.675654 (+ 897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51350: BlockingRecv error: recv got EOF from 127.0.0.1:51350 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260924 12:59:08.774701 2050 catalog_manager.cc:1259] Loaded cluster ID: 41e6a397f3054d4dbf55a454fc84365c
I20260924 12:59:08.774833 2050 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda: loading cluster ID for follower catalog manager: success
I20260924 12:59:08.777516 2050 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda: acquiring CA information for follower catalog manager: success
I20260924 12:59:08.779471 2050 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d4516a703b5746d995e167fc21466eda: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 12:59:08.816797 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.808438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33840 (local address 127.11.49.125:41683)
0924 12:59:08.808770 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.808781 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.808822 (+ 41us) server_negotiation.cc:407] Connection header received
0924 12:59:08.809064 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.809073 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.809219 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.809406 (+ 187us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.809990 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.811845 (+ 1855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.813612 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.814675 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.814906 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.815513 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.815750 (+ 237us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.815891 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.816132 (+ 241us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.816318 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260924 12:59:08.833700 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.827002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51360 (local address 127.11.49.124:37907)
0924 12:59:08.827325 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.827336 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.827714 (+ 378us) server_negotiation.cc:407] Connection header received
0924 12:59:08.828061 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.828065 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.828255 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.828460 (+ 205us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.828920 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.829782 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.831270 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.831733 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.831896 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.832462 (+ 566us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.833035 (+ 573us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.833219 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.833278 (+ 59us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.833374 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260924 12:59:08.857662 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.843419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51366 (local address 127.11.49.124:37907)
0924 12:59:08.843727 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.843737 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.845176 (+ 1439us) server_negotiation.cc:407] Connection header received
0924 12:59:08.845634 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.845645 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.845798 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.845908 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.846922 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.848367 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.851264 (+ 2897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.852187 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.852353 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.856451 (+ 4098us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.856678 (+ 227us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.856758 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.857053 (+ 295us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.857184 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260924 12:59:08.860659 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.845405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33842 (local address 127.11.49.125:41683)
0924 12:59:08.845695 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.845772 (+ 77us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.851923 (+ 6151us) server_negotiation.cc:407] Connection header received
0924 12:59:08.852087 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.852093 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.852197 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.852357 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.853014 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.854399 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.857587 (+ 3188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.858297 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.858397 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.858966 (+ 569us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.859152 (+ 186us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.859268 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.860109 (+ 841us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.860210 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260924 12:59:08.863047 2181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 12:59:08.843418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50746 (local address 127.11.49.126:45897)
0924 12:59:08.844244 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0924 12:59:08.844253 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 12:59:08.852468 (+ 8215us) server_negotiation.cc:407] Connection header received
0924 12:59:08.852663 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 12:59:08.852672 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 12:59:08.852993 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 12:59:08.853240 (+ 247us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 12:59:08.854021 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.855444 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.858232 (+ 2788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 12:59:08.859112 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 12:59:08.859288 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 12:59:08.860037 (+ 749us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 12:59:08.860742 (+ 705us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 12:59:08.860868 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0924 12:59:08.862392 (+ 1524us) server_negotiation.cc:299] Negotiation successful
0924 12:59:08.862555 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":475,"threads_started":1}
I20260924 12:59:08.869215 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 1790
I20260924 12:59:08.870818 1852 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:59:08.991204 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 1790
I20260924 12:59:09.011596 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 1864
I20260924 12:59:09.012951 1926 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:59:09.141299 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 1864
I20260924 12:59:09.167053 11461 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvGPshr/build/asan/bin/kudu pid 1939
I20260924 12:59:09.168563 2001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 12:59:09.281019 11461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvGPshr/build/asan/bin/kudu with pid 1939
2026-09-24T12:59:09Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4968 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10459 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (422260 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST